hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3079) usercache/<user>/appcache/<appid> directory not removed when using DefaultContainerExecutor
Date Tue, 11 Oct 2011 20:43:12 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13125369#comment-13125369
] 

Siddharth Seth commented on MAPREDUCE-3079:
-------------------------------------------

https://issues.apache.org/jira/browse/MAPREDUCE-2751 added a log message when the the DCE
fails to delete a file (using the FileContext API). This could happen with the container dir
or the app dir. We could either retry or try figuring out why the filecontext api is failing
to delete the file.
                
> usercache/<user>/appcache/<appid> directory not removed when using DefaultContainerExecutor
> -------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3079
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3079
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Thomas Graves
>            Priority: Critical
>             Fix For: 0.23.0
>
>
> Running with the DefaultContainerExecutor it appears that the usercache/<user>/appcache/<appid>
directory itself is not removed when the app finishes.  All the directories under it are properly
removed though.
> The nodemanager log file indicates that it tries to delete it:
> 11/09/23 15:17:56 INFO nodemanager.DefaultContainerExecutor: Deleting absolute path :
/home/hadoop/mapred/tmp/mapred-local/usercache/tgraves/appcache/application_1316722920862_0003
> This doesn't appear to happen with the LinuxContainerExecutor.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message