giraph-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Han JU <ju.han.fe...@gmail.com>
Subject NullPointerException at the last superstep
Date Fri, 17 May 2013 10:55:20 GMT
Hi,

I'm developing my first application based on Giraph 1.0.0.
I make it run on our cluster. It's a job with fixed number of supersteps.
Everything runs smoothly until the last superstep, this Exception got
caught in every worker:

java.lang.IllegalStateException: run: Caught an unrecoverable
exception waitFor: ExecutionException occurred while waiting for
org.apache.giraph.utils.ProgressableUtils$FutureWaitable@203c9616
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:102)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:416)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalStateException: waitFor:
ExecutionException occurred while waiting for
org.apache.giraph.utils.ProgressableUtils$FutureWaitable@203c9616
	at org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:151)
	at org.apache.giraph.utils.ProgressableUtils.waitForever(ProgressableUtils.java:111)
	at org.apache.giraph.utils.ProgressableUtils.getFutureResult(ProgressableUtils.java:73)
	at org.apache.giraph.utils.ProgressableUtils.getResultsWithNCallables(ProgressableUtils.java:192)
	at org.apache.giraph.worker.BspServiceWorker.saveVertices(BspServiceWorker.java:981)
	at org.apache.giraph.worker.BspServiceWorker.cleanup(BspServiceWorker.java:1014)
	at org.apache.giraph.graph.GraphTaskManager.cleanup(GraphTaskManager.java:873)
	at org.apache.giraph.graph.GraphMapper.cleanup(GraphMapper.java:82)
	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:94)
	... 7 more
Caused by: java.util.concurrent.ExecutionException:
java.lang.NullPointerException
	at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:262)
	at java.util.concurrent.FutureTask.get(FutureTask.java:119)
	at org.apache.giraph.utils.ProgressableUtils$FutureWaitable.waitFor(ProgressableUtils.java:271)
	at org.apache.giraph.utils.ProgressableUtils.waitFor(ProgressableUtils.java:143)
	... 15 more
Caused by: java.lang.NullPointerException
	at org.apache.giraph.worker.BspServiceWorker$1$1.call(BspServiceWorker.java:945)
	at org.apache.giraph.worker.BspServiceWorker$1$1.call(BspServiceWorker.java:940)
	at org.apache.giraph.utils.LogStacktraceCallable.call(LogStacktraceCallable.java:51)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
	at java.lang.Thread.run(Thread.java:636)

It seems like an exception in the framework ...
I guess that it may be linked with my output format since it's the last
superstep, so I simplified it (which is based on TextVertexOuputFomat) so
that it just output a string "aaa" for each vertex. But this problem is
still there.

Any suggestions or pointers?

Many thanks!

-- 
*JU Han*

Software Engineer Intern @ KXEN Inc.
UTC   -  Université de Technologie de Compiègne
*     **GI06 - Fouille de Données et Décisionnel*

+33 0619608888

Mime
View raw message