spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tathagata Das <tathagata.das1...@gmail.com>
Subject Re: How to use spark-submit
Date Wed, 07 May 2014 01:27:55 GMT
Doesnt the run-example script work for you? Also, are you on the latest
commit of branch-1.0 ?

TD


On Mon, May 5, 2014 at 7:51 PM, Soumya Simanta <soumya.simanta@gmail.com>wrote:

>
>
> Yes, I'm struggling with a similar problem where my class are not found on
> the worker nodes. I'm using 1.0.0_SNAPSHOT.  I would really appreciate if
> someone can provide some documentation on the usage of spark-submit.
>
> Thanks
>
> > On May 5, 2014, at 10:24 PM, Stephen Boesch <javadba@gmail.com> wrote:
> >
> >
> > I have a spark streaming application that uses the external streaming
> modules (e.g. kafka, mqtt, ..) as well.  It is not clear how to properly
> invoke the spark-submit script: what are the ---driver-class-path and/or
> -Dspark.executor.extraClassPath parameters required?
> >
> >  For reference, the following error is proving difficult to resolve:
> >
> > java.lang.ClassNotFoundException:
> org.apache.spark.streaming.examples.StreamingExamples
> >
>

Mime
View raw message