hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daryn Sharp (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-6021) MR AM should have working directory in LD_LIBRARY_PATH
Date Fri, 01 Aug 2014 15:48:38 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14082372#comment-14082372
] 

Daryn Sharp commented on MAPREDUCE-6021:
----------------------------------------

I think for uber mode to be complete transparent, the logic should be identical to {{TaskAttemptImpl}}.
 Ie. use {{crossPlatformifyMREnv}} for LD_LIBRARY_PATH and also set SHELL.

> MR AM should have working directory in LD_LIBRARY_PATH
> ------------------------------------------------------
>
>                 Key: MAPREDUCE-6021
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6021
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am
>    Affects Versions: 2.4.1
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: MAPREDUCE-6021.patch
>
>
> Tasks implicitly pick up shared libraries added to the job because the task launch context
explicitly adds the container working directory to LD_LIBRARY_PATH.  However the same is not
done for the AM container which is inconsistent.  User code can run in the AM via output committer,
speculator, uber job, etc., so the AM's LD_LIBRARY_PATH should have the container work directory
for consistency with tasks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message