hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Craig Welch (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2803) MR distributed cache not working correctly on Windows after NodeManager privileged account changes.
Date Wed, 05 Nov 2014 01:31:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14197305#comment-14197305
] 

Craig Welch commented on YARN-2803:
-----------------------------------

On Mac, cl.getResource("job.jar/") returns the directory (higher level entry), on windows
the same call is returning the jar file path (job.jar/job.jar).  I think this is the essential
issue, because when asking subsequently for "job.jar/lib/lib1.jar" the former finds the resource
and the latter (win) will not, as it is starting from the wrong place.  This certainly looks
like a classpath issue, either different content or different order.  still looking.

> MR distributed cache not working correctly on Windows after NodeManager privileged account
changes.
> ---------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2803
>                 URL: https://issues.apache.org/jira/browse/YARN-2803
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Chris Nauroth
>            Priority: Critical
>
> This problem is visible by running {{TestMRJobs#testDistributedCache}} or {{TestUberAM#testDistributedCache}}
on Windows.  Both tests fail.  Running git bisect, I traced it to the YARN-2198 patch to remove
the need to run NodeManager as a privileged account.  The tests started failing when that
patch was committed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message