spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <mich.talebza...@gmail.com>
Subject Re: Spark support for Complex Event Processing (CEP)
Date Thu, 21 Apr 2016 15:03:56 GMT
Hi,

Following example in

https://github.com/agsachin/spark/blob/CEP/external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala#L532

Does anyone know which jar file this belongs to?

I use *scalatest_2.11-2.2.6.jar *in my spark-shell

 spark-shell --master spark://50.140.197.217:7077 --jars
,/home/hduser/jars/junit-4.12.jar,/home/hduser/jars/spark-streaming-kafka-assembly_2.10-1.6.1.jar,
/*home/hduser/jars/scalatest_2.11-2.2.6.jar'*

scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll}
<console>:28: error: object scalatest is not a member of package org
         import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll}

Thanks


Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 20 April 2016 at 10:28, Mario Ds Briggs <mario.briggs@in.ibm.com> wrote:

> I did see your earlier post about Stratio decision. Will readup on it
>
>
> thanks
> Mario
>
> [image: Inactive hide details for Alonso Isidoro Roman ---20/04/2016
> 02:24:39 pm---Stratio decision could do the job https://github.com]Alonso
> Isidoro Roman ---20/04/2016 02:24:39 pm---Stratio decision could do the job
> https://github.com/Stratio/Decision
>
> From: Alonso Isidoro Roman <alonsoir@gmail.com>
> To: Mich Talebzadeh <mich.talebzadeh@gmail.com>
> Cc: Mario Ds Briggs/India/IBM@IBMIN, Luciano Resende <luckbr1975@gmail.com>,
> "user @spark" <user@spark.apache.org>
> Date: 20/04/2016 02:24 pm
> Subject: Re: Spark support for Complex Event Processing (CEP)
> ------------------------------
>
>
>
> Stratio decision could do the job
>
> *https://github.com/Stratio/Decision*
> <https://github.com/Stratio/Decision>
>
>
>
> Alonso Isidoro Roman.
>
> Mis citas preferidas (de hoy) :
> "Si depurar es el proceso de quitar los errores de software, entonces
> programar debe ser el proceso de introducirlos..."
>  -  Edsger Dijkstra
>
> My favorite quotes (today):
> "If debugging is the process of removing software bugs, then programming
> must be the process of putting ..."
>   - Edsger Dijkstra
>
> "If you pay peanuts you get monkeys"
>
>
> 2016-04-20 7:55 GMT+02:00 Mich Talebzadeh <*mich.talebzadeh@gmail.com*
> <mich.talebzadeh@gmail.com>>:
>
>    Thanks a lot Mario. Will have a look.
>
>    Regards,
>
>
>    Dr Mich Talebzadeh
>
>    LinkedIn
>    *https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*
>    <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>
>
>    *http://talebzadehmich.wordpress.com*
>    <http://talebzadehmich.wordpress.com/>
>
>
>
>    On 20 April 2016 at 06:53, Mario Ds Briggs <*mario.briggs@in.ibm.com*
>    <mario.briggs@in.ibm.com>> wrote:
>    Hi Mich,
>
>    Info is here - *https://issues.apache.org/jira/browse/SPARK-14745*
>    <https://issues.apache.org/jira/browse/SPARK-14745>
>
>    overview is in the pdf -
>    *https://issues.apache.org/jira/secure/attachment/12799670/SparkStreamingCEP.pdf*
>    <https://issues.apache.org/jira/secure/attachment/12799670/SparkStreamingCEP.pdf>
>
>    Usage examples not in the best place for now (will make it better) -
>    *https://github.com/agsachin/spark/blob/CEP/external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala#L532*
>    <https://github.com/agsachin/spark/blob/CEP/external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala#L532>
>
>    Your feedback is appreciated.
>
>
>    thanks
>    Mario
>
>    [image: Inactive hide details for Mich Talebzadeh ---19/04/2016
>    12:45:52 am---great stuff Mario. Much appreciated. Mich]Mich
>    Talebzadeh ---19/04/2016 12:45:52 am---great stuff Mario. Much appreciated.
>    Mich
>
>    From: Mich Talebzadeh <*mich.talebzadeh@gmail.com*
>    <mich.talebzadeh@gmail.com>>
>    To: Mario Ds Briggs/India/IBM@IBMIN
>    Cc: "user @spark" <*user@spark.apache.org* <user@spark.apache.org>>,
>    Luciano Resende <*luckbr1975@gmail.com* <luckbr1975@gmail.com>>
>    Date: 19/04/2016 12:45 am
>    Subject: Re: Spark support for Complex Event Processing (CEP)
>    ------------------------------
>
>
>
>
>    great stuff Mario. Much appreciated.
>
>    Mich
>
>    Dr Mich Talebzadeh
>
>    LinkedIn
>    *https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*
>    <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>
>
> *http://talebzadehmich.wordpress.com*
>    <http://talebzadehmich.wordpress.com/>
>
>
>
>    On 18 April 2016 at 20:08, Mario Ds Briggs <*mario.briggs@in.ibm.com*
>    <mario.briggs@in.ibm.com>> wrote:
>       Hey Mich, Luciano
>
>          Will provide links with docs by tomorrow
>
>          thanks
>          Mario
>
>          ----- Message from Mich Talebzadeh <*mich.talebzadeh@gmail.com*
>          <mich.talebzadeh@gmail.com>> on Sun, 17 Apr 2016 19:17:38 +0100
>          -----
>
>          *To:*
>          Luciano Resende <*luckbr1975@gmail.com* <luckbr1975@gmail.com>>
>
>          *cc:*
>          "user @spark" <*user@spark.apache.org* <user@spark.apache.org>>
>
>          *Subject:*
>          Re: Spark support for Complex Event Processing (CEP)Thanks
>          Luciano. Appreciated.
>
>          Regards
>
>          Dr Mich Talebzadeh
>
>          LinkedIn
>          *https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*
>          <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>
>
> *http://talebzadehmich.wordpress.com*
>          <http://talebzadehmich.wordpress.com/>
>
>
>
>          On 17 April 2016 at 17:32, Luciano Resende <
>          *luckbr1975@gmail.com* <luckbr1975@gmail.com>> wrote:
>             Hi Mitch,
>
>                      I know some folks that were
>                      investigating/prototyping on this area, let me see if I can get
them to
>                      reply here with more details.
>
>                      On Sun, Apr 17, 2016 at 1:54 AM, Mich Talebzadeh <
>                      *mich.talebzadeh@gmail.com*
>                      <mich.talebzadeh@gmail.com>> wrote:
>                      Hi,
>
>                      Has Spark got libraries for CEP using Spark
>                      Streaming with Kafka by any chance?
>
>                      I am looking at Flink that supposed to have these
>                      libraries for CEP but I find Flink itself very much work in progress.
>
>                      Thanks
>
>                      Dr Mich Talebzadeh
>
>                      LinkedIn
>                      *https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*
>                      <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>
>
> *http://talebzadehmich.wordpress.com*
>                      <http://talebzadehmich.wordpress.com/>
>
>
>
>
>
>                      --
>                      Luciano Resende
> *http://twitter.com/lresende1975* <http://twitter.com/lresende1975>
> *http://lresende.blogspot.com/* <http://lresende.blogspot.com/>
>
>
>
>
>
>

Mime
View raw message