Return-Path: X-Original-To: apmail-giraph-user-archive@www.apache.org Delivered-To: apmail-giraph-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D282591BF for ; Fri, 19 Dec 2014 10:09:37 +0000 (UTC) Received: (qmail 40241 invoked by uid 500); 19 Dec 2014 10:09:37 -0000 Delivered-To: apmail-giraph-user-archive@giraph.apache.org Received: (qmail 40176 invoked by uid 500); 19 Dec 2014 10:09:37 -0000 Mailing-List: contact user-help@giraph.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@giraph.apache.org Delivered-To: mailing list user@giraph.apache.org Received: (qmail 40166 invoked by uid 99); 19 Dec 2014 10:09:37 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Dec 2014 10:09:37 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ingarleo@icloud.com designates 17.158.216.161 as permitted sender) Received: from [17.158.216.161] (HELO nk11p20im-asmtp002.me.com) (17.158.216.161) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Dec 2014 10:09:11 +0000 Received: from host245-40.diei.unipg.it (host245-40.diei.unipg.it [141.250.40.245]) by nk11p20im-asmtp002.me.com (Oracle Communications Messaging Server 7.0.5.33.0 64bit (built Aug 27 2014)) with ESMTPSA id <0NGT004EIQF8JX20@nk11p20im-asmtp002.me.com> for user@giraph.apache.org; Fri, 19 Dec 2014 09:59:35 +0000 (GMT) From: Alessio Arleo Content-type: multipart/alternative; boundary="Apple-Mail=_6CBECBF8-DD73-4529-B99B-FC82E6926AD1" Subject: MapWritables as messages Message-id: <6CCED073-A61D-4BEA-9B59-C9961B613FE8@icloud.com> Date: Fri, 19 Dec 2014 10:59:30 +0100 To: user@giraph.apache.org MIME-version: 1.0 (Mac OS X Mail 8.1 \(1993\)) X-Mailer: Apple Mail (2.1993) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.13.68,1.0.33,0.0.0000 definitions=2014-12-19_03:2014-12-19,2014-12-19,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 suspectscore=1 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1412080000 definitions=main-1412190101 X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_6CBECBF8-DD73-4529-B99B-FC82E6926AD1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hello everyone. For my custom Giraph Job I chose MapWritables as messages for my = vertices. I got this weird exception (attached below) while trying to run it: the = first run goes ok, but then it crashes. I think it can be a = serialization/deserialization problem. I would like to know if I am the only one experiencing this kind of = problem and if you guys have any suggestion to make. Thanks in advance. Here is the trace of the error: ######## Caused by: java.util.concurrent.ExecutionException: = java.lang.IllegalStateException: next: IOException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:202) at = org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(Progressa= bleUtils.java:271) at = org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:1= 43) ... 13 more Caused by: java.lang.IllegalStateException: next: IOException at = org.apache.giraph.utils.ByteArrayVertexIdData$VertexIdDataIterator.next(By= teArrayVertexIdData.java:211) at = org.apache.giraph.comm.messages.ByteArrayMessagesPerVertexStore.addPartiti= onMessages(ByteArrayMessagesPerVertexStore.java:116) at = org.apache.giraph.comm.requests.SendWorkerMessagesRequest.doRequest(SendWo= rkerMessagesRequest.java:72) at = org.apache.giraph.comm.netty.NettyWorkerClientRequestProcessor.doRequest(N= ettyWorkerClientRequestProcessor.java:470) at = org.apache.giraph.comm.netty.NettyWorkerClientRequestProcessor.flush(Netty= WorkerClientRequestProcessor.java:419) at = org.apache.giraph.graph.ComputeCallable.call(ComputeCallable.java:193) at = org.apache.giraph.graph.ComputeCallable.call(ComputeCallable.java:70) at = org.apache.giraph.utils.LogStacktraceCallable.call(LogStacktraceCallable.j= ava:51) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at = java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1145) at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: ensureRemaining: Only 720 bytes = remaining, trying to read 5888 at = org.apache.giraph.utils.UnsafeByteArrayInputStream.ensureRemaining(UnsafeB= yteArrayInputStream.java:114) at = org.apache.giraph.utils.UnsafeByteArrayInputStream.readFully(UnsafeByteArr= ayInputStream.java:128) at = org.apache.giraph.utils.UnsafeByteArrayInputStream.readUTF(UnsafeByteArray= InputStream.java:275) at = org.apache.hadoop.io.AbstractMapWritable.readFields(AbstractMapWritable.ja= va:199) at = org.apache.hadoop.io.MapWritable.readFields(MapWritable.java:146) at = org.apache.giraph.utils.ByteArrayVertexIdMessages.readData(ByteArrayVertex= IdMessages.java:76) at = org.apache.giraph.utils.ByteArrayVertexIdMessages.readData(ByteArrayVertex= IdMessages.java:34) at = org.apache.giraph.utils.ByteArrayVertexIdData$VertexIdDataIterator.next(By= teArrayVertexIdData.java:209) ... 11 more ##### Dott. Alessio Arleo Dottorando in Ingegneria Industriale e dell=E2=80=99Informazione Dottore in Ingegneria Informatica ed Elettronica Dottore Magistrale in Ingegneria Informatica e dell=E2=80=99Automazione Linkedin: it.linkedin.com/in/IngArleo = Skype: Dr. Alessio Arleo Tel: +39 075 5853920 Cell: +39 349 0575782 --Apple-Mail=_6CBECBF8-DD73-4529-B99B-FC82E6926AD1 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
Hello everyone.

For my custom Giraph Job I chose = MapWritables as messages for my vertices.

I got this weird exception (attached = below) while trying to run it: the first run goes ok, but then it = crashes. I think it can be a serialization/deserialization = problem.

I = would like to know if I am the only one experiencing this kind of = problem and if you guys have any suggestion to make.

Thanks in advance. Here = is the trace of the error:

########
Caused by: = java.util.concurrent.ExecutionException: = java.lang.IllegalStateException: next: IOException
= at = java.util.concurrent.FutureTask.report(FutureTask.java:122)
= at = java.util.concurrent.FutureTask.get(FutureTask.java:202)
= at = org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(Progressa= bleUtils.java:271)
at = org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:1= 43)
... 13 more
Caused by: java.lang.IllegalStateException: next: = IOException
at = org.apache.giraph.utils.ByteArrayVertexIdData$VertexIdDataIterator.next(By= teArrayVertexIdData.java:211)
at = org.apache.giraph.comm.messages.ByteArrayMessagesPerVertexStore.addPartiti= onMessages(ByteArrayMessagesPerVertexStore.java:116)
= at = org.apache.giraph.comm.requests.SendWorkerMessagesRequest.doRequest(SendWo= rkerMessagesRequest.java:72)
at = org.apache.giraph.comm.netty.NettyWorkerClientRequestProcessor.doRequest(N= ettyWorkerClientRequestProcessor.java:470)
at = org.apache.giraph.comm.netty.NettyWorkerClientRequestProcessor.flush(Netty= WorkerClientRequestProcessor.java:419)
at = org.apache.giraph.graph.ComputeCallable.call(ComputeCallable.java:193)
at = org.apache.giraph.graph.ComputeCallable.call(ComputeCallable.java:70)
= at = org.apache.giraph.utils.LogStacktraceCallable.call(LogStacktraceCallable.j= ava:51)
at = java.util.concurrent.FutureTask.run(FutureTask.java:262)
= at = java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:= 1145)
at = java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :615)
at = java.lang.Thread.run(Thread.java:745)
Caused by: = java.io.IOException: ensureRemaining: Only 720 bytes remaining, trying = to read 5888
at = org.apache.giraph.utils.UnsafeByteArrayInputStream.ensureRemaining(UnsafeB= yteArrayInputStream.java:114)
at = org.apache.giraph.utils.UnsafeByteArrayInputStream.readFully(UnsafeByteArr= ayInputStream.java:128)
at = org.apache.giraph.utils.UnsafeByteArrayInputStream.readUTF(UnsafeByteArray= InputStream.java:275)
at = org.apache.hadoop.io.AbstractMapWritable.readFields(AbstractMapWritable.ja= va:199)
at = org.apache.hadoop.io.MapWritable.readFields(MapWritable.java:146)
= at = org.apache.giraph.utils.ByteArrayVertexIdMessages.readData(ByteArrayVertex= IdMessages.java:76)
at = org.apache.giraph.utils.ByteArrayVertexIdMessages.readData(ByteArrayVertex= IdMessages.java:34)
at = org.apache.giraph.utils.ByteArrayVertexIdData$VertexIdDataIterator.next(By= teArrayVertexIdData.java:209)
... 11 = more
#####

=
Dott. Alessio Arleo

Dottorando in Ingegneria Industriale e = dell=E2=80=99Informazione

Dottore in Ingegneria Informatica ed Elettronica
Dottore Magistrale in Ingegneria Informatica e = dell=E2=80=99Automazione

Linkedin: it.linkedin.com/in/IngArleo
Skype: Dr. Alessio Arleo

Tel: +39 075 5853920
Cell: +39 349 0575782








= --Apple-Mail=_6CBECBF8-DD73-4529-B99B-FC82E6926AD1--