hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christian Kunz (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2867) Add a task's cwd to it's LD_LIBRARY_PATH
Date Mon, 19 May 2008 13:56:55 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597958#action_12597958
] 

Christian Kunz commented on HADOOP-2867:
----------------------------------------

bq. The -program option in pipes is expected to take only executable URI. Comma separated
files ending up in local cache looks like a hack. Should this be supported? Either we support
or not, I think this needs to be documented.

We need the support for sure, whether implemented less hacky or not.

bq. do you mean the immediate parents of all mapred.cache.localFiles or the whole parent hierarchy
of mapred.cache.localFiles?

files in mapred.cache.localFiles usually have their own specific subdirectory, i.e. when one
of them is a shared library, then it should be sufficient to include its parent directory
into LD_LIBRARY_PATH

> Add a task's cwd to it's LD_LIBRARY_PATH
> ----------------------------------------
>
>                 Key: HADOOP-2867
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2867
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.17.0
>            Reporter: Arun C Murthy
>            Assignee: Amareshwari Sriramadasu
>             Fix For: 0.18.0
>
>         Attachments: patch-2867.txt
>
>
> HADOOP-1660 added the task's cwd to it's java.library.path which means only java task's
can take advantage via System.load or System.loadLibrary... we should enhance it to support
Hadoop Pipes applications by adding it to the LD_LIBRARY_PATH so they can use dlopen/dlsym
etc.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message