hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siddharth Seth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2757) [MR-279] Redundant "file:" directory created in appcache
Date Thu, 25 Aug 2011 20:26:29 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13091298#comment-13091298
] 

Siddharth Seth commented on MAPREDUCE-2757:
-------------------------------------------

For now, we should probably just have a utility function to figure out how to interpret paths
specified by the user - this can take care of converting them to the correct format or spewing
out warnings (ref: DataNode.getStorageDirs). Having a consistent format for specifying local
dirs between MR and HDFS would be nice.
The LocalDirAllocator could be changed to work with and without schemes (accepting only file:)
while still working with absolute and relative paths. That would be a hadoop common jira.


> [MR-279] Redundant "file:" directory created in appcache 
> ---------------------------------------------------------
>
>                 Key: MAPREDUCE-2757
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2757
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramya Sunil
>            Assignee: Jonathan Eagles
>            Priority: Minor
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-2757-trunk-v1.patch
>
>
> A redundant directory called "file:" is being created under ${yarn.server.nodemanager.local-dir}/usercache/${username}/appcache/appID
which further has a directory structure ${yarn.server.nodemanager.local-dir}/usercache/${username}/(appcache|filecache)/appID/filecache
which is empty. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message