hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2838) Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for jni
Date Tue, 02 Jun 2009 15:57:07 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715563#action_12715563
] 

Todd Lipcon commented on HADOOP-2838:
-------------------------------------

Using a comma separated conf variable here seems slightly dangerous. I imagine there must
be some cases where people want to pass commas as part of their environment. I don't have
a concrete example, but it seems it's only a matter of time until some streaming application
comes along and really needs a comma in its environment, and then we're stuck dealing with
escaping, etc.

What about using the entire mapred.child.env namespace, and iterating over it? So mapred.child.env.LD_LIBRARY_PATH
would hold the value for that environment variable.

Unfortunately this would either involve iterating over and filtering all of the conf vars,
or switching the "Properties" class used for storage inside Configuration to be a SortedMap
so we can do a prefix match. I don't particularly like the former, and the latter is a bigger
change, but the interface does seem simpler and also more robust. For example, a sysadmin
could set a final property of LD_LIBRARY_PATH="path/to/some.so" to provide some kind of security
sandboxing while still allowing the user to modify other variables in the environment.

> Add HADOOP_LIBRARY_PATH config setting so Hadoop will include external directories for
jni
> ------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-2838
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2838
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: mapred
>    Affects Versions: 0.16.0
>            Reporter: Owen O'Malley
>            Assignee: Amar Kamat
>         Attachments: HADOOP-2838-v1.0.patch, HADOOP-2838-v1.1.patch
>
>
> Currently there is no way to configure Hadoop to use external JNI directories. I propose
we add a new variable like HADOOP_CLASS_PATH that is added to the JAVA_LIBRARY_PATH before
the process is run.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message