hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2757) [MR-279] Redundant "file:" directory created in appcache
Date Wed, 24 Aug 2011 20:36:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090460#comment-13090460

Jonathan Eagles commented on MAPREDUCE-2757:

Further analysis

ContainerLocalizer.initDirs qualifies (e.g. file:///tmp instead of just /tmp) all paths and
then serializes the qualified path as strings into the Configuration. Qualified paths are
not part of the supported interface as part of the fs LocalDirAllocator. It in turn tries
to deserializes the qualified path strings directly into a java.io.File. Thus instead of testing
to see whether the path is user writable, it instead recursively creates a dir name file:
containing a dir named tmp in the current working directory of the local file system.

> [MR-279] Redundant "file:" directory created in appcache 
> ---------------------------------------------------------
>                 Key: MAPREDUCE-2757
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2757
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramya Sunil
>            Assignee: Jonathan Eagles
>            Priority: Minor
>             Fix For: 0.23.0
> A redundant directory called "file:" is being created under ${yarn.server.nodemanager.local-dir}/usercache/${username}/appcache/appID
which further has a directory structure ${yarn.server.nodemanager.local-dir}/usercache/${username}/(appcache|filecache)/appID/filecache
which is empty. 

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message