giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Avery Ching <ach...@apache.org>
Subject Re: reason behind a java.io.EOFException
Date Tue, 11 Sep 2012 05:53:48 GMT
These days we are focusing more on the netty IPC.  Can you try 
-Dgiraph.useNetty=true?

Avery

On 9/10/12 2:08 PM, Franco Maria Nardini wrote:
> Dear all,
>
> I am working with Giraph 0.2/Hadoop 1.0.3. In particular, I am trying
> to execute the following code:
>
> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner \
> org.apache.giraph.examples.SimplePageRankVertex \
> -w 2 \
> -if org.apache.giraph.examples.SimplePageRankVertex\$SimplePageRankVertexInputFormat
> -ip bigGraph.txt \
> -of org.apache.giraph.io.IdWithValueTextOutputFormat -op output \
> -mc org.apache.giraph.examples.SimplePageRankVertex\$HDFSBasedPageRankVertexMasterCompute
>
> If I set the number of workers equal to two, one of the mappers produce:
>
> ava.lang.RuntimeException: java.io.IOException: Call to
> zipottero.local/172.20.10.3:30001 failed on local exception:
> java.io.EOFException
> 	at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionRequest(BasicRPCCommunications.java:923)
> 	at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:327)
> 	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:604)
> 	at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:377)
> 	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:578)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.io.IOException: Call to
> zipottero.local/172.20.10.3:30001 failed on local exception:
> java.io.EOFException
> 	at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
> 	at org.apache.hadoop.ipc.Client.call(Client.java:1075)
> 	at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
> 	at $Proxy3.putVertexList(Unknown Source)
> 	at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionRequest(BasicRPCCommunications.java:920)
> 	... 11 more
> Caused by: java.io.EOFException
> 	at java.io.DataInputStream.readInt(DataInputStream.java:375)
> 	at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804)
> 	at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749)
>
> while it perfectly works if the number of workers is set to 1. I am
> experiencing the problem both on small and big graphs.
>
> Any idea of the reasons behind this behavior?
>
> Thanks a lot in advance.
>
> Best,
>
> FM
> --
> Franco Maria Nardini
>
> High Performance Computing Laboratory
> Istituto di Scienza e Tecnologie dell’Informazione (ISTI)
> Consiglio Nazionale delle Ricerche (CNR)
> Via G. Moruzzi, 1
> 56124, Pisa, Italy
>
> Phone: +39 050 315 3496
> Fax: +39 050 315 2040
> Mail: francomaria.nardini@isti.cnr.it
> Skype: francomaria.nardini
> Web: http://hpc.isti.cnr.it/~nardini/


Mime
View raw message