giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Simon McGloin <simonmcgl...@gmail.com>
Subject Already has missing vertex on this worker
Date Thu, 24 Oct 2013 17:31:43 GMT
Hey guys,

I am constantly getting the error below on a worker as soon as superstep 1
begins. Can anyone explain what it means and how I can fix it.

Thanks,
Simon


Command:
hadoop jar lib/GiraphTest.jar org.apache.giraph.GiraphRunner
-Dgiraph.zkList=10.10.5.103:2181,10.10.5.104:2181,10.10.5.105:2181-Dgiraph.checkpointFrequency=1
-Dgiraph.useOutOfCoreGraph=true
-Dgiraph.useOutOfCoreMessages=true -Dgiraph.numComputeThreads=4
-Dgiraph.maxPartitionsInMemory=1 -Dgiraph.numOutputThreads=4
-Dgiraph.maxMessagesInMemory=100000
-Dgiraph.messagesDirectory=/storage/giraph/messages/
-Dgiraph.partitionsDirectory=/storage/giraph/partitions/
com.mycompany.tarantula.batchlayer.giraph.run.UndirectedFeaturesVertex -eif
com.mycompany.tarantula.batchlayer.giraph.io.CustomInputFormat -eip
/user/simon/input/ -of
org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op
/user/simon/output -w 10


Error:
java.lang.IllegalStateException: run: Caught an unrecoverable exception
resolveMutations: Already has missing vertex on this worker for 957442
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: resolveMutations: Already has
missing vertex on this worker for 9574422
at
org.apache.giraph.comm.netty.NettyWorkerServer.resolveMutations(NettyWorkerServer.java:184)
at
org.apache.giraph.comm.netty.NettyWorkerServer.prepareSuperstep(NettyWorkerServer.java:152)
at
org.apache.giraph.worker.BspServiceWorker.startSuperstep(BspServiceWorker.java:677)
at
org.apache.giraph.graph.GraphTaskManager.execute(GraphTaskManager.java:249)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:92)
... 7 more

Mime
View raw message