spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ankur Dave <>
Subject Re: the pregel operator of graphx throws NullPointerException
Date Tue, 29 Jul 2014 19:49:28 GMT
Denis RP <> writes:
> [error] (run-main-0) org.apache.spark.SparkException: Job aborted due to stage failure:
Task 6.0:4 failed 4 times, most recent failure: Exception failure in TID 598 on host worker6.local:
> [error]         scala.collection.Iterator$$anon$
> [error]         scala.collection.Iterator$class.foreach(Iterator.scala:727)
> [error]         scala.collection.AbstractIterator.foreach(Iterator.scala:1157)

It looks like Iterator.scala:328 [1] is Iterator#map, and it's likely failing because the
map function is null.

I haven't seen this before, but I wonder if SPARK-2292 [2] is related. The stack trace is
different there, but the problem of a function being null is the same. Based on the JIRA comments,
it might be a problem with your build and launch process. How are you deploying your application?



View raw message