hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6021) MR AM should add working directory to LD_LIBRARY_PATH
Date Fri, 01 Aug 2014 15:14:38 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jason Lowe updated MAPREDUCE-6021:

    Attachment: MAPREDUCE-6021.patch

Patch so YARNRunner adds {{PWD}} to the front of LD_LIBRARY_PATH.  Tested via a unit test
in the patch and manually tested by running a job with -Dyarn.app.mapreduce.am.env='LD_DEBUG=libs'
and examining the search path logs emitted from the dynamic linker.

> MR AM should add working directory to LD_LIBRARY_PATH
> -----------------------------------------------------
>                 Key: MAPREDUCE-6021
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6021
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mr-am
>    Affects Versions: 2.4.1
>            Reporter: Jason Lowe
>         Attachments: MAPREDUCE-6021.patch
> Tasks implicitly pick up shared libraries added to the job because the task launch context
explicitly adds the container working directory to LD_LIBRARY_PATH.  However the same is not
done for the AM container which is inconsistent.  User code can run in the AM via output committer,
speculator, uber job, etc., so the AM's LD_LIBRARY_PATH should have the container work directory
for consistency with tasks.

This message was sent by Atlassian JIRA

View raw message