hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anubhav Dhoot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11764) Hadoop should have the option to use directory other than tmp for extracting and loading leveldbjni
Date Tue, 14 Apr 2015 23:49:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14495167#comment-14495167
] 

Anubhav Dhoot commented on HADOOP-11764:
----------------------------------------

bq. the native code is still not linked if JAVA_LIBRARY_PATH doesn't include library.leveldbjni.path
(by default it doesn't library.leveldbjni.path is some customized path).
[~zjshen] The custom library.leveldbjni.path does not need to be added to JAVA_LIBRARY_PATH.
Copied below by sample test where i created a new directory and set only the HADOOP_LEVELDBJNI_DIR
to point to it

mkdir /testleveldb
export HADOOP_LEVELDBJNI_DIR=/testleveldb

/usr/java/default/bin/java -Dproc_nodemanager -Dhadoop.log.dir=/home/adhoot/src/mr2-pseudo-dist/hadoop-3.0.0-SNAPSHOT/logs
-Dyarn.log.dir=/home/adhoot/src/mr2-pseudo-dist/hadoop-3.0.0-SNAPSHOT/logs -Dhadoop.log.file=yarn.log
-Dyarn.log.file=yarn.log -Dyarn.home.dir= -Dyarn.id.str= -Dhadoop.root.logger=INFO,console
-Dyarn.root.logger=INFO,console -Dyarn.policy.file=hadoop-policy.xml -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=8001
-Dhadoop.home.dir=/home/adhoot/src/mr2-pseudo-dist/hadoop-3.0.0-SNAPSHOT -Dhadoop.id.str=root
-Dhadoop.policy.file=hadoop-policy.xml -Dhadoop.security.logger=INFO,NullAppender -Dlibrary.leveldbjni.path=/testleveldb
org.apache.hadoop.yarn.server.nodemanager.NodeManager

[root@anuonebox ah]# dir /testleveldb/
libleveldbjni-64-1-219738139685490287.8

> Hadoop should have the option to use directory other than tmp for extracting and loading
leveldbjni
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-11764
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11764
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Anubhav Dhoot
>            Assignee: Anubhav Dhoot
>         Attachments: YARN-3331.001.patch, YARN-3331.002.patch
>
>
> /tmp can be  required to be noexec in many environments. This causes a problem when 
nodemanager tries to load the leveldbjni library which can get unpacked and executed from
/tmp.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message