giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Avery Ching (JIRA)" <>
Subject [jira] [Created] (GIRAPH-351) Fail job early when there is no input
Date Fri, 28 Sep 2012 20:58:09 GMT
Avery Ching created GIRAPH-351:

             Summary: Fail job early when there is no input
                 Key: GIRAPH-351
             Project: Giraph
          Issue Type: Improvement
            Reporter: Avery Ching

Right now we get a cryptic error message when we know that there is no input!

2012-09-28 13:45:20,410 INFO org.apache.giraph.graph.BspServiceMaster: generateInputSplits:
Got 0 input splits for 100 workers
2012-09-28 13:45:20,410 WARN org.apache.giraph.graph.BspServiceMaster: createInputSplits:
Number of inputSplits=0 < 100=number of healthy processes, some workers will be not used

But the job keeps on going and the workers get the exception 

java.lang.IllegalStateException: setup: loadVertices failed due to KeeperException
	at org.apache.giraph.graph.BspServiceWorker.setup(
	at org.apache.giraph.graph.GraphMapper.setup(
	at org.apache.hadoop.mapred.MapTask.runNewMapper(
	at org.apache.hadoop.mapred.Child.main(
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /_hadoopBsp/job_201209271814.325_0001/_inputSplitDir
	at org.apache.zookeeper.KeeperException.create(
	at org.apache.zookeeper.KeeperException.create(
	at org.apache.zookeeper.ZooKeeper.getChildren(
	at org.apache.zookeeper.ZooKeeper.getChildren(
	at org.apache.giraph.zk.ZooKeeperExt.getChildrenExt(
	at org.apache.giraph.graph.BspServiceWorker.reserveInputSplit(
	at org.apache.giraph.graph.BspServiceWorker.loadVertices(
	at org.apache.giraph.graph.BspServiceWorker.setup(
	... 5 more

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message