Mailing-List: contact dev-help@giraph.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@giraph.apache.org
Date: Sat, 29 Sep 2012 08:19:08 +1100 (NCT)
From: "Avery Ching (JIRA)" <jira@apache.org>
To: giraph-dev@incubator.apache.org
Message-ID: <1120645468.140984.1348867148338.JavaMail.jiratomcat@arcas>
In-Reply-To: <839687260.140896.1348865889148.JavaMail.jiratomcat@arcas>
Subject: [jira] [Updated] (GIRAPH-351) Fail job early when there is no input
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/GIRAPH-351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Avery Ching updated GIRAPH-351:
-------------------------------

    Attachment: GIRAPH-351.patch

Here is a fix.
2012-09-28 14:11:10,686 INFO org.apache.giraph.graph.BspServiceMaster: generateInputSplits: Got 0 input splits for 100 workers
2012-09-28 14:11:10,686 WARN org.apache.giraph.graph.BspServiceMaster: createInputSplits: Number of inputSplits=0 < 100=number of healthy processes, some workers will be not used
2012-09-28 14:11:10,686 FATAL org.apache.giraph.graph.BspServiceMaster: createInputSplits: Failing job due to 0 input splits, check input {classname}!
2012-09-28 14:11:10,686 FATAL org.apache.giraph.graph.BspServiceMaster: failJob: Killing job job_201209271814.337_0001


> Fail job early when there is no input
> -------------------------------------
>
>                 Key: GIRAPH-351
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-351
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Avery Ching
>         Attachments: GIRAPH-351.patch
>
>
> Right now we get a cryptic error message when we know that there is no input!
> 2012-09-28 13:45:20,410 INFO org.apache.giraph.graph.BspServiceMaster: generateInputSplits: Got 0 input splits for 100 workers
> 2012-09-28 13:45:20,410 WARN org.apache.giraph.graph.BspServiceMaster: createInputSplits: Number of inputSplits=0 < 100=number of healthy processes, some workers will be not used
> But the job keeps on going and the workers get the exception 
> java.lang.IllegalStateException: setup: loadVertices failed due to KeeperException
> 	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:628)
> 	at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:370)
> 	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:570)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:632)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:171)
> Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /_hadoopBsp/job_201209271814.325_0001/_inputSplitDir
> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:102)
> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1243)
> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1271)
> 	at org.apache.giraph.zk.ZooKeeperExt.getChildrenExt(ZooKeeperExt.java:273)
> 	at org.apache.giraph.graph.BspServiceWorker.reserveInputSplit(BspServiceWorker.java:225)
> 	at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:320)
> 	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:607)
> 	... 5 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira