spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "DeepakVohra (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-5483) java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
Date Fri, 30 Jan 2015 18:32:34 GMT

    [ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299009#comment-14299009
] 

DeepakVohra edited comment on SPARK-5483 at 1/30/15 6:31 PM:
-------------------------------------------------------------

Is the Maven dependency >spark-mllib_2.10 not a Spark issue?

<dependency>
			<groupId>org.apache.spark</groupId>
			<artifactId>spark-mllib_2.10</artifactId>
			<version>1.2.0</version>
		</dependency>

There must be some issue in how you are adding the classes to the classpath.

Modifying "2.10" to "2.11" fixes the issue and the org.apache.spark.mllib.* packages get found,
but introduces the Scala version issue.



was (Author: dvohra):
Is the Maven dependency >spark-mllib_2.10 not a Spark issue?

<dependency>
			<groupId>org.apache.spark</groupId>
			<artifactId>spark-mllib_2.10</artifactId>
			<version>1.2.0</version>
		</dependency>

There must be some issue in how you are adding the classes to the classpath.

Modifying "2.10" to "2.11" fixes the issue of the org.apache.spark.mllib.* packages being
found.


> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> -------------------------------------------------------------------------------------------
>
>                 Key: SPARK-5483
>                 URL: https://issues.apache.org/jira/browse/SPARK-5483
>             Project: Spark
>          Issue Type: Bug
>          Components: MLlib
>    Affects Versions: 1.2.0
>         Environment: Maven
> Spark 1.2
>            Reporter: DeepakVohra
>
> Naive Bayes classifier generates following error.
> ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> 	at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> 	at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> 	at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> 	at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> 	at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> 	at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> 	at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> 	at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> 	at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> 	at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> 	at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> 	at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> 	at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> 	at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> 	at org.apache.spark.scheduler.Task.run(Task.scala:56)
> 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> 15/01/28 21:50:06 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor
task launch worker-0,5,main]
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> 	at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> 	at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> 	at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> 	at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> 	at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> 	at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> 	at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> 	at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> 	at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> 	at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> 	at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> 	at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> 	at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> 	at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> 	at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> 	at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> 	at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> 	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> 	at org.apache.spark.scheduler.Task.run(Task.scala:56)
> 	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message