Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@crunch.apache.org
Received-SPF: pass (nike.apache.org: domain of danushka.menikkumbura@gmail.com
 designates 209.85.212.179 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAH29n6Nmu1NPinH3E5VnTaKB=c+iRHy5VcO_evZmOWt0GRsYZw@mail.gmail.com>
References: 
 <CAF4V=3GK+cU91uXAapS2Q8-9oBzJsvO1C9x_h8CM_vMVF8JAvg@mail.gmail.com>
 <CAAZ8Dxo-bWy-wgr8bCTez+rZrFewCvFVK6=852qe-RZy-OPTbQ@mail.gmail.com>
 <CAF4V=3E3cVo3euN9u8xqeU-Kt7+OMkGHeufon-4wSxZV74qhfA@mail.gmail.com>
 <CAH29n6Nmu1NPinH3E5VnTaKB=c+iRHy5VcO_evZmOWt0GRsYZw@mail.gmail.com>
From: Danushka Menikkumbura <danushka.menikkumbura@gmail.com>
Date: Mon, 12 Jan 2015 18:13:19 -0500
Message-ID: 
 <CAF4V=3EnnV2GEWV7U9MkDZ5FZEE3Zg+23+HsjdKQJgi5yPFVXQ@mail.gmail.com>
Subject: Re: Spark Examples
To: dev <dev@crunch.apache.org>
Content-Type: multipart/alternative; boundary=f46d04389255b434f4050c7ca807

--f46d04389255b434f4050c7ca807
Content-Type: text/plain; charset=UTF-8

Aha!. This is perfect.

Thanks J!

Danushka

On Mon, Jan 12, 2015 at 5:57 PM, Josh Wills <jwills@cloudera.com> wrote:

> Hey Danushka,
>
> The spark branch on my crunch-demo app has a Spark example as well:
>
> https://github.com/jwills/crunch-demo/tree/spark
>
> I/you would need to update the POM to work against version 0.11.0-hadoop2
> and the latest Spark release, either Spark 1.1 or 1.2 should work fine.
>
> J
>
> On Mon, Jan 12, 2015 at 2:27 PM, Danushka Menikkumbura <
> danushka.menikkumbura@gmail.com> wrote:
>
> > Thanks Jinal!
> >
> > On Mon, Jan 12, 2015 at 4:43 PM, Jinal Shah <jinalshah2007@gmail.com>
> > wrote:
> >
> > > Hi Danushka,
> > >
> > > The user guide might be a good resource to start with
> > > https://crunch.apache.org/user-guide.html#sparkpipeline
> > >
> > > You can use the Crunch WordCount example:
> > >
> > >
> >
> https://github.com/apache/crunch/blob/master/crunch-archetype/src/main/resources/archetype-resources/src/main/java/WordCount.java
> > >
> > > These are some blogs you can use to learn
> > > http://crunch-tutor.blogspot.com/2014/12/crunch-dofn-example.html
> > > http://engineering.cerner.com/blog/scaling-people-with-apache-crunch/
> > >
> > >
> > > Thanks
> > > Jinal
> > >
> > > On Mon, Jan 12, 2015 at 1:19 PM, Danushka Menikkumbura <
> > > danushka.menikkumbura@gmail.com> wrote:
> > >
> > > > Hi devs,
> > > >
> > > > I am trying to understand the behavior of Crunch with Spark. In order
> > to
> > > do
> > > > that I need to run an example so that I can step through the code.
> > Could
> > > > someone point me to any resources that you think would be helpful
> > > please?.
> > > >
> > > > Thanks,
> > > > Danushka
> > > >
> > >
> >
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>

--f46d04389255b434f4050c7ca807--