spark-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject spark git commit: [SPARK-7050] [BUILD] Fix Python Kafka test assembly jar not found issue under Maven build
Date Wed, 08 Jul 2015 11:23:15 GMT
Repository: spark
Updated Branches:
  refs/heads/master 351a36d0c -> 8a9d9cc15

[SPARK-7050] [BUILD] Fix Python Kafka test assembly jar not found issue under Maven build

 To fix Spark Streaming unit test with maven build. Previously the name and path of maven
generated jar is different from sbt, which will lead to following exception. This fix keep
the same behavior with both Maven and sbt build.

Failed to find Spark Streaming Kafka assembly jar in /home/xyz/spark/external/kafka-assembly
You need to build Spark with  'build/sbt assembly/assembly streaming-kafka-assembly/assembly'
or 'build/mvn package' before running this program

Author: jerryshao <>

Closes #5632 from jerryshao/SPARK-7050 and squashes the following commits:

74b068d [jerryshao] Fix mvn build issue


Branch: refs/heads/master
Commit: 8a9d9cc1561cf157793c90db6700ffa6f1f00a69
Parents: 351a36d
Author: jerryshao <>
Authored: Wed Jul 8 12:23:32 2015 +0100
Committer: Sean Owen <>
Committed: Wed Jul 8 12:23:32 2015 +0100

 external/kafka-assembly/pom.xml | 1 +
 1 file changed, 1 insertion(+)
diff --git a/external/kafka-assembly/pom.xml b/external/kafka-assembly/pom.xml
index 8059c44..977514f 100644
--- a/external/kafka-assembly/pom.xml
+++ b/external/kafka-assembly/pom.xml
@@ -58,6 +58,7 @@
+        <outputFile>${}/scala-${scala.binary.version}/spark-streaming-kafka-assembly-${project.version}.jar</outputFile>

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message