incubator-hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Jungblut <thomas.jungb...@googlemail.com>
Subject Re: java.lang.NoClassDefFoundError: org/xerial/snappy/SnappyInputStream
Date Thu, 23 Feb 2012 11:36:30 GMT
It seems that Dain's snappy is buggy. I tried the Hadoop codec as well as
directly using streams. However, I just changed it to the xerial version in
POM and it now works correctly.

I will contact dain and try to sort out things.  Please update the trunk
and rebuild.
Sorry for the inconvenience.

2012/2/23 Thomas Jungblut <thomas.jungblut@googlemail.com>

> Yep, maybe this is the issue. In the Maven POM is the dain version, in
> impor statements the xerial version. Sorry for the inconsistency. I fix it.
>
>
> 2012/2/23 Thomas Jungblut <thomas.jungblut@googlemail.com>
>
>> Wait a minute, I guess this is the wrong library.
>>
>> My intention was to use the  https://github.com/dain/snappy lib, since
>> it is faster than the JNI port.
>> I investigate it after launch.
>>
>>
>> 2012/2/23 Edward J. Yoon <edwardyoon@apache.org>
>>
>>> Hmm, the snappy-0.2.jar is already in lib folder.
>>>
>>> edward@slave:~/workspace/hama-trunk$ ls lib/
>>> ant-1.7.1.jar           commons-configuration-1.6.jar
>>> hadoop-test-1.0.0.jar         jetty-util-6.1.14.jar
>>> netty-3.2.6.Final.jar    zookeeper-3.3.3.jar
>>> ant-launcher-1.7.1.jar  commons-lang-2.6.jar
>>> jackson-core-asl-1.9.2.jar    jsp-2.1-6.1.14.jar
>>> servlet-api-6.0.32.jar
>>> avro-1.6.0.jar          commons-logging-1.1.1.jar
>>> jackson-mapper-asl-1.9.2.jar  jsp-api-2.1-6.1.14.jar
>>> slf4j-api-1.5.8.jar
>>> avro-ipc-1.6.0.jar      guava-10.0.1.jar
>>> jetty-6.1.14.jar              junit-4.8.1.jar
>>> slf4j-log4j12-1.5.8.jar
>>> commons-cli-1.2.jar     hadoop-core-1.0.0.jar
>>> jetty-annotations-6.1.14.jar  log4j-1.2.16.jar        snappy-0.2.jar
>>>
>>>
>>> On Thu, Feb 23, 2012 at 4:51 PM, Thomas Jungblut
>>> <thomas.jungblut@googlemail.com> wrote:
>>> > You have to update your jars, Snappy is a new dependency for
>>> compression.
>>> >
>>> > 2012/2/23 Edward J. Yoon <edwardyoon@apache.org>
>>> >
>>> >> I received below error message with pi example.
>>> >>
>>> >> 12/02/23 15:26:16 DEBUG sync.ZooKeeperSyncClientImpl: leaveBarrier()
>>> >> at superstep:-1 znode size: (0) znodes:[]
>>> >> 12/02/23 15:26:16 WARN bsp.GroomServer: Error running child
>>> >> java.lang.NoClassDefFoundError: org/xerial/snappy/SnappyInputStream
>>> >>        at java.lang.Class.forName0(Native Method)
>>> >>        at java.lang.Class.forName(Class.java:247)
>>> >>        at
>>> >>
>>> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:819)
>>> >>        at
>>> >>
>>> org.apache.hama.bsp.message.compress.BSPMessageCompressorFactory.getCompressor(BSPMessageCompressorFactory.java:37)
>>> >>        at
>>> >>
>>> org.apache.hama.bsp.message.CompressableMessageManager.initCompression(CompressableMessageManager.java:36)
>>> >>        at
>>> >>
>>> org.apache.hama.bsp.message.AvroMessageManagerImpl.init(AvroMessageManagerImpl.java:60)
>>> >>        at org.apache.hama.bsp.BSPPeerImpl.<init>(BSPPeerImpl.java:145)
>>> >>        at
>>> >>
>>> org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:969)
>>> >> Caused by: java.lang.ClassNotFoundException:
>>> >> org.xerial.snappy.SnappyInputStream
>>> >>        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>> >>        at java.security.AccessController.doPrivileged(Native Method)
>>> >>        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>> >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>> >>        at
>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>> >>        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>>> >>
>>> >>
>>> >> --
>>> >> Best Regards, Edward J. Yoon
>>> >> @eddieyoon
>>> >>
>>> >
>>> >
>>> >
>>> > --
>>> > Thomas Jungblut
>>> > Berlin <thomas.jungblut@gmail.com>
>>>
>>>
>>>
>>> --
>>> Best Regards, Edward J. Yoon
>>> @eddieyoon
>>>
>>
>>
>>
>> --
>> Thomas Jungblut
>> Berlin <thomas.jungblut@gmail.com>
>>
>
>
>
> --
> Thomas Jungblut
> Berlin <thomas.jungblut@gmail.com>
>



-- 
Thomas Jungblut
Berlin <thomas.jungblut@gmail.com>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message