hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-3124) mapper failed with failed to load native libs
Date Thu, 13 Oct 2011 14:38:11 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Vinod Kumar Vavilapalli updated MAPREDUCE-3124:

    Status: Open  (was: Patch Available)

Hard coding "Linux-i386-32" won't fly. I guess you can use the {{PlatformName}} class in Hadoop
common utils package, but please test and verify. Thanks.
> mapper failed with failed to load native libs
> ---------------------------------------------
>                 Key: MAPREDUCE-3124
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3124
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0, 0.24.0
>            Reporter: Thomas Graves
>            Assignee: John George
>            Priority: Blocker
>             Fix For: 0.23.0
>         Attachments: MAPREDUCE-3124.patch, MAPREDUCE-3124.patch
> hadoop jar hadoop-mapreduce-examples-*.jar sort -Dmapreduce.job.acl-view
> -job=* -Dmapreduce.map.output.compress=true 
> -Dmapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.GzipCodec 
> -Dmapreduce.output.fileoutputformat.compress=true  -Dmapreduce.output.fileoutputformat.compression.type=NONE
> reduce.output.fileoutputformat.compression.codec=org.apache.hadoop.io.compress.GzipCodec
> org.apache.hadoop.io.Text -outValue org.apache.hadoop.io.Text  Compression/textinput
> This will fail with native libs not found error unless -Dmapred.child.java.opts='-Djava.library.path=${HADOOP_COMMON_HOME}/lib/native/Linux-i386-32'
is added.
> The error in container log:
> 2011-09-29 17:06:56,787 DEBUG org.apache.hadoop.util.NativeCodeLoader: Trying to load
the custom-built native-hadoop
> library...2011-09-29 17:06:56,787 DEBUG org.apache.hadoop.util.NativeCodeLoader: Failed
to load native-hadoop with
> error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path2011-09-29 17:06:56,787
> org.apache.hadoop.util.NativeCodeLoader:
> java.library.path=/share/gridjdk-1.6.0_21/jre/lib/i386/server:/share/gridjdk-1.6.0_21/jre/lib/i386:/share/gridjdk-1.6.0_21/jre/../lib/i386:/tmp/mapred-local/usercache/hadoopqa/appcache/application_1317314754104_0012/container_1317314754104_0012_01_000002:/current/lib:/usr/java/packages/lib/i386:/lib:/usr/lib2011-09-29
> 17:06:56,787 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop
library for your platform...
> using builtin-java classes where applicable
> Also note that the error that shows up at the application master for this is terrible:
> Container killed by the ApplicationMaster. Container killed on request. Exit code is
137 Too Many fetch failures.Failing the attempt 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message