hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (YARN-7433) java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support.
Date Mon, 06 Nov 2017 16:46:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jason Lowe resolved YARN-7433.
------------------------------
    Resolution: Invalid

Closing this since this is a user issue with the build and/or deployment of Hadoop and not
a bug in Hadoop itself.


> java.lang.RuntimeException: native snappy library not available: this version of libhadoop
was built without snappy support.
> ----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-7433
>                 URL: https://issues.apache.org/jira/browse/YARN-7433
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: gehaijiang
>            Priority: Trivial
>
> From centos6.5 upgrade centos7,    hadoop version(2.7.1) is compiled on centos6.5 and
Support snappy,   the copy runs on centos7.
> but  yarn task error ,yarn  task errorlog: 
> (hadoop Native Libraries Whether to recompile based on centos7???)
> Error: java.lang.RuntimeException: native snappy library not available: this version
of libhadoop was built without snappy support.
> 	at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:65)
> 	at org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:134)
> 	at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150)
> 	at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:165)
> 	at org.apache.hadoop.mapred.IFile$Writer.<init>(IFile.java:114)
> 	at org.apache.hadoop.mapred.IFile$Writer.<init>(IFile.java:97)
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:1856)
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1511)
> 	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:723)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:793)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> 	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> Error: java.io.IOException: Spill failed



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message