spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sudhanshu Janghel <sudhanshu.jang...@cloudwick.com>
Subject building kafka project on intellij Help is much appreciated
Date Thu, 07 Apr 2016 16:08:19 GMT
Hello,

I am new to building kafka and wish to understand how to make fat jars in
intellij.
The sbt assembly seems confusing and I am unable to resolve the
dependencies.

here is my build.sbt

name := "twitter"

version := "1.0"
scalaVersion := "2.10.4"



//libraryDependencies += "org.slf4j" % "slf4j-api" % "1.7.7" % "provided"
//libraryDependencies += "org.slf4j" % "slf4j-log4j12" % "1.7.7" % "provided"
//libraryDependencies += "com.google.guava" % "guava" % "11.0.2"
exclude("log4j", "log4j") exclude("org.slf4j","slf4j-log4j12")
exclude("org.slf4j","slf4j-api")
libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "1.6.0"
libraryDependencies +=   "org.apache.kafka" %% "kafka"  % "1.6.0"
libraryDependencies += "org.apache.spark" %
"spark-streaming-kafka_2.10" % "1.6.0"



adn here is my assembly.sbt

addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.3")


the error faced is

Error:Error while importing SBT project:<br/>...<br/><pre>[info]
Resolving org.scala-sbt#tracking;0.13.8 ...
[info] Resolving org.scala-sbt#cache;0.13.8 ...
[info] Resolving org.scala-sbt#testing;0.13.8 ...
[info] Resolving org.scala-sbt#test-agent;0.13.8 ...
[info] Resolving org.scala-sbt#test-interface;1.0 ...
[info] Resolving org.scala-sbt#main-settings;0.13.8 ...
[info] Resolving org.scala-sbt#apply-macro;0.13.8 ...
[info] Resolving org.scala-sbt#command;0.13.8 ...
[info] Resolving org.scala-sbt#logic;0.13.8 ...
[info] Resolving org.scala-sbt#precompiled-2_8_2;0.13.8 ...
[info] Resolving org.scala-sbt#precompiled-2_9_2;0.13.8 ...
[info] Resolving org.scala-sbt#precompiled-2_9_3;0.13.8 ...
[trace] Stack trace suppressed: run 'last *:update' for the full output.
[trace] Stack trace suppressed: run 'last *:ssExtractDependencies' for
the full output.
[error] (*:update) sbt.ResolveException: unresolved dependency:
com.eed3si9n#sbt-assembly;0.14.3: not found
[error] unresolved dependency: org.apache.kafka#kafka_2.10;1.6.0: not found
[error] (*:ssExtractDependencies) sbt.ResolveException: unresolved
dependency: com.eed3si9n#sbt-assembly;0.14.3: not found
[error] unresolved dependency: org.apache.kafka#kafka_2.10;1.6.0: not found
[error] Total time: 18 s, completed Apr 7, 2016 5:05:06 PM

Mime
View raw message