hama-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HAMA-928) FAILED_TO_UNCOMPRESS with a lot of messages
Date Tue, 03 Mar 2015 00:06:08 GMT

    [ https://issues.apache.org/jira/browse/HAMA-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344083#comment-14344083
] 

Hudson commented on HAMA-928:
-----------------------------

SUCCESS: Integrated in Hama-Nightly-for-Hadoop-1.x #1538 (See [https://builds.apache.org/job/Hama-Nightly-for-Hadoop-1.x/1538/])
HAMA-928: Fix compressor bugs (edwardyoon: rev 1663476)
* /hama/trunk/conf/hama-default.xml
* /hama/trunk/core/pom.xml
* /hama/trunk/core/src/main/java/org/apache/hama/Constants.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPJob.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/BSPPeerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/LocalBSPRunner.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/HamaAsyncMessageManagerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/HamaMessageManagerImpl.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/BSPMessageCompressorFactory.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/Bzip2Compressor.java
* /hama/trunk/core/src/main/java/org/apache/hama/bsp/message/compress/SnappyCompressor.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/TestBSPMasterGroomServer.java
* /hama/trunk/core/src/test/java/org/apache/hama/bsp/message/compress/TestBSPMessageCompressor.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/PiEstimator.java
* /hama/trunk/examples/src/main/java/org/apache/hama/examples/SemiClusterJobDriver.java
* /hama/trunk/examples/src/test/java/org/apache/hama/examples/SemiClusterMatchingTest.java
* /hama/trunk/graph/src/test/java/org/apache/hama/graph/TestSubmitGraphJob.java
* /hama/trunk/pom.xml


> FAILED_TO_UNCOMPRESS with a lot of messages
> -------------------------------------------
>
>                 Key: HAMA-928
>                 URL: https://issues.apache.org/jira/browse/HAMA-928
>             Project: Hama
>          Issue Type: Bug
>            Reporter: Edward J. Yoon
>            Assignee: Edward J. Yoon
>             Fix For: 0.7.0
>
>         Attachments: HAMA-928_v01.patch
>
>
> This error occurs when a lot of messages need to be (un)compressed.
> {code}
> 15/02/26 09:31:58 ERROR compress.BSPMessageCompressor: Unable to decompress.
> java.io.IOException: FAILED_TO_UNCOMPRESS(5)
> 	at org.xerial.snappy.SnappyNative.throw_error(SnappyNative.java:78)
> 	at org.xerial.snappy.SnappyNative.rawUncompress(Native Method)
> 	at org.xerial.snappy.Snappy.rawUncompress(Snappy.java:395)
> 	at org.xerial.snappy.Snappy.uncompress(Snappy.java:431)
> 	at org.xerial.snappy.SnappyInputStream.readFully(SnappyInputStream.java:127)
> 	at org.xerial.snappy.SnappyInputStream.readHeader(SnappyInputStream.java:88)
> 	at org.xerial.snappy.SnappyInputStream.<init>(SnappyInputStream.java:58)
> 	at org.apache.hama.bsp.message.compress.SnappyCompressor.decompress(SnappyCompressor.java:80)
> 	at org.apache.hama.bsp.BSPMessageBundle$1.next(BSPMessageBundle.java:142)
> 	at org.apache.hama.bsp.BSPMessageBundle$1.next(BSPMessageBundle.java:110)
> 	at org.apache.hama.bsp.LocalBSPRunner$LocalMessageManager.transfer(LocalBSPRunner.java:364)
> 	at org.apache.hama.bsp.BSPPeerImpl.sync(BSPPeerImpl.java:385)
> 	at org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:138)
> 	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:258)
> 	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:288)
> 	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:212)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> 15/02/26 09:31:58 ERROR bsp.BSPPeerImpl: Error while sending messages
> java.lang.NullPointerException
> 	at org.apache.hama.bsp.message.compress.SnappyCompressor.decompress(SnappyCompressor.java:88)
> 	at org.apache.hama.bsp.BSPMessageBundle$1.next(BSPMessageBundle.java:142)
> 	at org.apache.hama.bsp.BSPMessageBundle$1.next(BSPMessageBundle.java:110)
> 	at org.apache.hama.bsp.LocalBSPRunner$LocalMessageManager.transfer(LocalBSPRunner.java:364)
> 	at org.apache.hama.bsp.BSPPeerImpl.sync(BSPPeerImpl.java:385)
> 	at org.apache.hama.graph.GraphJobRunner.bsp(GraphJobRunner.java:138)
> 	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:258)
> 	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:288)
> 	at org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:212)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message