giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Franco Maria Nardini <francomaria.nard...@isti.cnr.it>
Subject reason behind a java.io.EOFException
Date Mon, 10 Sep 2012 21:08:22 GMT
Dear all,

I am working with Giraph 0.2/Hadoop 1.0.3. In particular, I am trying
to execute the following code:

hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
org.apache.giraph.GiraphRunner \
org.apache.giraph.examples.SimplePageRankVertex \
-w 2 \
-if org.apache.giraph.examples.SimplePageRankVertex\$SimplePageRankVertexInputFormat
-ip bigGraph.txt \
-of org.apache.giraph.io.IdWithValueTextOutputFormat -op output \
-mc org.apache.giraph.examples.SimplePageRankVertex\$HDFSBasedPageRankVertexMasterCompute

If I set the number of workers equal to two, one of the mappers produce:

ava.lang.RuntimeException: java.io.IOException: Call to
zipottero.local/172.20.10.3:30001 failed on local exception:
java.io.EOFException
	at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionRequest(BasicRPCCommunications.java:923)
	at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:327)
	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:604)
	at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:377)
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:578)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.io.IOException: Call to
zipottero.local/172.20.10.3:30001 failed on local exception:
java.io.EOFException
	at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
	at org.apache.hadoop.ipc.Client.call(Client.java:1075)
	at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
	at $Proxy3.putVertexList(Unknown Source)
	at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionRequest(BasicRPCCommunications.java:920)
	... 11 more
Caused by: java.io.EOFException
	at java.io.DataInputStream.readInt(DataInputStream.java:375)
	at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:804)
	at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749)

while it perfectly works if the number of workers is set to 1. I am
experiencing the problem both on small and big graphs.

Any idea of the reasons behind this behavior?

Thanks a lot in advance.

Best,

FM
--
Franco Maria Nardini

High Performance Computing Laboratory
Istituto di Scienza e Tecnologie dell’Informazione (ISTI)
Consiglio Nazionale delle Ricerche (CNR)
Via G. Moruzzi, 1
56124, Pisa, Italy

Phone: +39 050 315 3496
Fax: +39 050 315 2040
Mail: francomaria.nardini@isti.cnr.it
Skype: francomaria.nardini
Web: http://hpc.isti.cnr.it/~nardini/

Mime
View raw message