giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-488) ArrayOutOfBoundsException in org.apache.giraph.worker.InputSplitPathOrganizer
Date Tue, 22 Jan 2013 22:04:12 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eli Reisman updated GIRAPH-488:
-------------------------------

    Attachment: GIRAPH-488-1.patch

This fixes it, sorry about the delay I had not peeked at the JIRA this weekend ;)

As I sort of stated in the previous post, this kind of error only shows up occasionally and
in big jobs, so if Sebastian could re-run this same job on Giraph + this patch, we can confirm
the problem is solved. But this is what solved it before, so I think we're good to go.

This passes 'mvn verify' and will fix the problem for all profiles/builds.

                
> ArrayOutOfBoundsException in org.apache.giraph.worker.InputSplitPathOrganizer
> -----------------------------------------------------------------------------
>
>                 Key: GIRAPH-488
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-488
>             Project: Giraph
>          Issue Type: Bug
>    Affects Versions: 0.2.0
>            Reporter: Sebastian Schelter
>         Attachments: GIRAPH-488-1.patch
>
>
> I ran into a strange exception when testing the RandomWalkVertex on a cluster of 26 machines
running Hadoop 1.0.4
> {noformat}
> java.lang.IllegalStateException: run: Caught an unrecoverable exception Index: 225, Size:
205
> 	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:735)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 225, Size: 205
> 	at java.util.ArrayList.rangeCheckForAdd(ArrayList.java:612)
> 	at java.util.ArrayList.addAll(ArrayList.java:554)
> 	at org.apache.giraph.worker.InputSplitPathOrganizer.prioritizeLocalInputSplits(InputSplitPathOrganizer.java:140)
> 	at org.apache.giraph.worker.InputSplitPathOrganizer.<init>(InputSplitPathOrganizer.java:93)
> 	at org.apache.giraph.worker.InputSplitsCallable.<init>(InputSplitsCallable.java:140)
> 	at org.apache.giraph.worker.VertexInputSplitsCallable.<init>(VertexInputSplitsCallable.java:97)
> 	at 
> org.apache.giraph.worker.VertexInputSplitsCallableFactory.newCallable(VertexInputSplitsCallableFactory.java:86)
> 	at org.apache.giraph.worker.BspServiceWorker.loadInputSplits(BspServiceWorker.java:266)
> 	at org.apache.giraph.worker.BspServiceWorker.loadVertices(BspServiceWorker.java:310)
> 	at org.apache.giraph.worker.BspServiceWorker.setup(BspServiceWorker.java:483)
> 	at org.apache.giraph.graph.GraphMapper.map(GraphMapper.java:525)
> 	at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:723)
> 	... 7 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message