spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evan Chan ...@ooyala.com>
Subject Re: Getting failures in FileServerSuite
Date Wed, 30 Oct 2013 19:44:50 GMT
Must be a local environment thing, because AmpLab Jenkins can't
reproduce it..... :-p

On Wed, Oct 30, 2013 at 11:10 AM, Josh Rosen <rosenville@gmail.com> wrote:
> Someone on the users list also encountered this exception:
>
> https://mail-archives.apache.org/mod_mbox/incubator-spark-user/201310.mbox/%3C64474308D680D540A4D8151B0F7C03F7025EF289%40SHSMSX104.ccr.corp.intel.com%3E
>
>
> On Wed, Oct 30, 2013 at 9:40 AM, Evan Chan <ev@ooyala.com> wrote:
>
>> I'm at the latest
>>
>> commit f0e23a023ce1356bc0f04248605c48d4d08c2d05
>> Merge: aec9bf9 a197137
>> Author: Reynold Xin <rxin@apache.org>
>> Date:   Tue Oct 29 01:41:44 2013 -0400
>>
>>
>> and seeing this when I do a "test-only FileServerSuite":
>>
>> 13/10/30 09:35:04.300 INFO DAGScheduler: Completed ResultTask(0, 0)
>> 13/10/30 09:35:04.307 INFO LocalTaskSetManager: Loss was due to
>> java.io.StreamCorruptedException
>> java.io.StreamCorruptedException: invalid type code: AC
>>         at
>> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)
>>         at java.io.ObjectInputStream.readObject(ObjectInputStream.java:348)
>>         at
>> org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:39)
>>         at
>> org.apache.spark.serializer.DeserializationStream$$anon$1.getNext(Serializer.scala:101)
>>         at
>> org.apache.spark.util.NextIterator.hasNext(NextIterator.scala:71)
>>         at scala.collection.Iterator$$anon$21.hasNext(Iterator.scala:440)
>>         at
>> org.apache.spark.util.CompletionIterator.hasNext(CompletionIterator.scala:26)
>>         at
>> org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:27)
>>         at
>> org.apache.spark.Aggregator.combineCombinersByKey(Aggregator.scala:53)
>>         at
>> org.apache.spark.rdd.PairRDDFunctions$$anonfun$combineByKey$2.apply(PairRDDFunctions.scala:95)
>>         at
>> org.apache.spark.rdd.PairRDDFunctions$$anonfun$combineByKey$2.apply(PairRDDFunctions.scala:94)
>>         at
>> org.apache.spark.rdd.MapPartitionsWithContextRDD.compute(MapPartitionsWithContextRDD.scala:40)
>>         at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:237)
>>         at org.apache.spark.rdd.RDD.iterator(RDD.scala:226)
>>         at
>> org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:107)
>>         at org.apache.spark.scheduler.Task.run(Task.scala:53)
>>         at
>> org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:212)
>>         at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>         at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>         at java.lang.Thread.run(Thread.java:680)
>>
>>
>> Anybody else seen this yet?
>>
>> I have a really simple PR and this fails without my change, so I may
>> go ahead and submit it anyways.
>>
>> --
>> --
>> Evan Chan
>> Staff Engineer
>> ev@ooyala.com  |
>>



-- 
--
Evan Chan
Staff Engineer
ev@ooyala.com  |

Mime
View raw message