giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-321) Divide by 0 exception
Date Fri, 07 Sep 2012 17:27:07 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450807#comment-13450807
] 

Eli Reisman commented on GIRAPH-321:
------------------------------------

Avery, this is also an important fix for situations where the path list is temporarily empty
because every split found on the list turned out to be local and was therefore pulled out
of the original list to be sorted to the front. When we try to find a hashed index to append
the locality list back into the path list, the path list is actually empty and the div by
zero occurs. I imagine there are a lot of single node cluster and pseudo situations where
this will always be the case.

Thanks again, nice save!

                
> Divide by 0 exception
> ---------------------
>
>                 Key: GIRAPH-321
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-321
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Avery Ching
>         Attachments: GIRAPH-321-1.patch
>
>
> hadoop jar giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar
> org.apache.giraph.GiraphRunner \
>   org.apache.giraph.examples.SimplePageRankVertex -w 1 \
>   -if org.apache.giraph.examples.LongDoubleFloatDoubleTextInputFormat
> -ip graph.txt
>   -of org.apache.giraph.examples.VertexWithDoubleValueFloatEdgeTextOutputFormat
> -op output
> where graph.txt has the following content:
> 1 2:1.0 3:1.0 4:1.0
> 2 1:1.0 3:1.0
> 3 1:1.0
> 4 1:1.0 3:1.0
> One of the mappers gives throws a divbyzero exception.
> java.lang.ArithmeticException: / by zero
> 	at org.apache.giraph.graph.LocalityInfoSorter.prioritizeLocalInputSplits(LocalityInfoSorter.java:107)
> 	at org.apache.giraph.graph.LocalityInfoSorter.<init>(LocalityInfoSorter.java:71)
> 	at org.apache.giraph.graph.BspServiceWorker.reserveInputSplit(BspServiceWorker.java:228)
> 	at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:317)
> 	at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:604)
> 	at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:368)
> 	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:569)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:249)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message