hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashish Kumar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1791) Distributed cache issue using YARN
Date Thu, 06 Mar 2014 15:32:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13922651#comment-13922651

Ashish Kumar commented on YARN-1791:

Thank you Jason! I'll use that email for any further query.

> Distributed cache issue using YARN
> ----------------------------------
>                 Key: YARN-1791
>                 URL: https://issues.apache.org/jira/browse/YARN-1791
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Ashish Kumar
> If I want to have two cache files a/b/c and d/e/c for an MR job then is there any way
to access Path of these files while reading it in Map or Reduce task?
> I'm using *job.addCacheFile(hdfsPath.toUri());* And then I'm accessing all cache file
paths using *context.getLocalCacheFiles()* which returns all paths as given below:
> /yarn/?/?/?/1234/c and /yarn/?/?/?/2345/c
> But these paths don't have any folder level info so I'm not able to identify which path
is representing a/b/c. Is it bug?
> Please help.
> Thanks,
> Ashish

This message was sent by Atlassian JIRA

View raw message