Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 353811097E for ; Wed, 26 Mar 2014 14:59:28 +0000 (UTC) Received: (qmail 97398 invoked by uid 500); 26 Mar 2014 14:59:26 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 97252 invoked by uid 500); 26 Mar 2014 14:59:24 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@spark.apache.org Delivered-To: mailing list user@spark.apache.org Received: (qmail 97216 invoked by uid 99); 26 Mar 2014 14:59:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Mar 2014 14:59:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jaonary@gmail.com designates 209.85.215.42 as permitted sender) Received: from [209.85.215.42] (HELO mail-la0-f42.google.com) (209.85.215.42) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Mar 2014 14:59:19 +0000 Received: by mail-la0-f42.google.com with SMTP id ec20so1615174lab.1 for ; Wed, 26 Mar 2014 07:58:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=oUToF6URISUnpixvtrxPRFrVi+zC9jR1ClmbffJcVpM=; b=YupHHjMbVbLMz3KvNnMiBuljUJYL4QL/Pv+20EzWOSrdKqKM7dw8Pl8UnnyTxCioL6 jjYTK+bEqGtcGdEuVo7mKYcfcLUw3ZnORO94TZAhsnT5IU7rM1BA1U3vz81ULXZQkP8l 7naWHd25rIzKLVTU+jYL9n3+RGSXQxS0mBjGblNVuhPr9YvH3UZrrlHbN8dIZ4hhpOug DytIAiOUpv4Aq/YzetuibWS/OsnaWYBuU3SDbsFUi4ML1Es1S3SEVgM1ruVyNxNjDbW1 jqe12dRUDyyzGz7kXfDQFseHiAGGh26k9McuW1r4ky8+ARiHZH2eXSH/UtmHhxZgLtva /3yA== MIME-Version: 1.0 X-Received: by 10.152.28.41 with SMTP id y9mr356618lag.57.1395845938049; Wed, 26 Mar 2014 07:58:58 -0700 (PDT) Received: by 10.112.221.229 with HTTP; Wed, 26 Mar 2014 07:58:58 -0700 (PDT) In-Reply-To: <5332E559.5070509@plainvanillagames.com> References: <5332E559.5070509@plainvanillagames.com> Date: Wed, 26 Mar 2014 15:58:58 +0100 Message-ID: Subject: Re: java.lang.ClassNotFoundException From: Jaonary Rabarisoa To: user@spark.apache.org Content-Type: multipart/alternative; boundary=089e0160a7044c74a604f583b506 X-Virus-Checked: Checked by ClamAV on apache.org --089e0160a7044c74a604f583b506 Content-Type: text/plain; charset=UTF-8 Here the output that I get : [error] (run-main-0) org.apache.spark.SparkException: Job aborted: Task 1.0:1 failed 4 times (most recent failure: Exception failure in TID 6 on host 172.166.86.36: java.lang.ClassNotFoundException: value.models.ReIdDataSetEntry) org.apache.spark.SparkException: Job aborted: Task 1.0:1 failed 4 times (most recent failure: Exception failure in TID 6 on host 172.166.86.36: java.lang.ClassNotFoundException: value.models.ReIdDataSetEntry) at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1011) at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1009) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) at org.apache.spark.scheduler.DAGScheduler.org $apache$spark$scheduler$DAGScheduler$$abortStage(DAGScheduler.scala:1009) at org.apache.spark.scheduler.DAGScheduler$$anonfun$processEvent$10.apply(DAGScheduler.scala:596) at org.apache.spark.scheduler.DAGScheduler$$anonfun$processEvent$10.apply(DAGScheduler.scala:596) at scala.Option.foreach(Option.scala:236) at org.apache.spark.scheduler.DAGScheduler.processEvent(DAGScheduler.scala:596) at org.apache.spark.scheduler.DAGScheduler$$anonfun$start$1$$anon$2$$anonfun$receive$1.applyOrElse(DAGScheduler.scala:146) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498) at akka.actor.ActorCell.invoke(ActorCell.scala:456) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237) at akka.dispatch.Mailbox.run(Mailbox.scala:219) at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Spark says that the jar is added : 14/03/26 15:49:18 INFO SparkContext: Added JAR target/scala-2.10/value-spark_2.10-1.0.jar On Wed, Mar 26, 2014 at 3:34 PM, Ognen Duzlevski < ognen@plainvanillagames.com> wrote: > Have you looked at the individual nodes logs? Can you post a bit more of > the exception's output? > > > On 3/26/14, 8:42 AM, Jaonary Rabarisoa wrote: > >> Hi all, >> >> I got java.lang.ClassNotFoundException even with "addJar" called. The >> jar file is present in each node. >> >> I use the version of spark from github master. >> >> Any ideas ? >> >> >> Jaonary >> > --089e0160a7044c74a604f583b506 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Here the = output that I get :

[error] (run-main-0) org.apache= .spark.SparkException: Job aborted: Task 1.0:1 failed 4 times (most recent = failure: Exception failure in TID 6 on host 172.166.86.36: java.lang.ClassNotFoundException: value.models.ReIdDat= aSetEntry)
org.apache.spark.SparkException: Job abo= rted: Task 1.0:1 failed 4 times (most recent failure: Exception failure in = TID 6 on host 172.166.86.36: java.lang= .ClassNotFoundException: value.models.ReIdDataSetEntry)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$s= park$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1011)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$s= park$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1009)
at scala.collection.mutable.ResizableArray$class.foreach(Resizab= leArray.scala:59)
at scala.collection.mutable.ArrayB= uffer.foreach(ArrayBuffer.scala:47)
at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DA= GScheduler$$abortStage(DAGScheduler.scala:1009)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$processEvent= $10.apply(DAGScheduler.scala:596)
at org.apache.spar= k.scheduler.DAGScheduler$$anonfun$processEvent$10.apply(DAGScheduler.scala:= 596)
at scala.Option.foreach(Option.scala:236)
at org.apache.spark.scheduler.DAGScheduler.processEvent(DAGScheduler.scala= :596)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$start$1$$ano= n$2$$anonfun$receive$1.applyOrElse(DAGScheduler.scala:146)
= at akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)
at akka.actor.ActorCell.invoke(ActorCell.scala:456)
=
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
= at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(= AbstractDispatcher.scala:386)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.ja= va:260)
at scala.concurrent.forkjoin.ForkJoinPool$Wo= rkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool= .java:1979)
at scala.concurrent.forkjoin.ForkJoinWor= kerThread.run(ForkJoinWorkerThread.java:107)

Spark says that the jar is added :

14/03/26 15:49:18 INFO SparkContext: Added JAR targ= et/scala-2.10/value-spark_2.10-1.0.jar





On Wed, Mar 26, 2014 at 3:34 PM= , Ognen Duzlevski <ognen@plainvanillagames.com> wr= ote:
Have you looked at the individual nodes logs= ? Can you post a bit more of the exception's output?


On 3/26/14, 8:42 AM, Jaonary Rabarisoa wrote:
Hi all,

I got java.lang.ClassNotFoundException even with "addJar" = called. The jar file is present in each node.

I use the version of spark from github master.

Any ideas ?


Jaonary

--089e0160a7044c74a604f583b506--