hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ramgopal <ramgopaln...@huawei.com>
Subject The temp folder _temporary (created as part of job execution) is not getting deleted from HDFS if the job fails because of jobs cleanup task failure
Date Wed, 03 Aug 2011 05:41:20 GMT
Hi all ,

 

I am executing a wordcount job. When all the map and reduce tasks are
completed ,the cleanup task is launched.

 

If the cleanup task fails, job also gets failed. 

 

As the mappers and reducers got executed successfully , the output files are
getting created.

 

But the output folder contains the temporary file /output/_temporary and
this will not be removed.

 

 

Here the framework should take care of cleaning the temporary files or
application should handle it ?

 

 

Regards,

Ramgopal


Mime
View raw message