Mailing-List: contact dev-help@airflow.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@airflow.incubator.apache.org
MIME-Version: 1.0
Sender: jayesh.senjaliya@gmail.com
In-Reply-To: <CANLtMid_jkbXT9yPkF371FCyWAjFzBUgBHchJ2aOVz6iKxp3sw@mail.gmail.com>
References: <CANSvDjrL4ceo8JgK2heeVpRwXMb9Tdhy8+RhMs9ckMDSZKdr3g@mail.gmail.com>
 <CANLtMie6Z8F72ic1fO47+cge8+PK8yCdS0f1JARWREiM=-31gQ@mail.gmail.com>
 <CANSvDjqUCiAndEaTiN3LJ89d=0XfFN8hjYxaXi5f-g10ABccmQ@mail.gmail.com> <CANLtMid_jkbXT9yPkF371FCyWAjFzBUgBHchJ2aOVz6iKxp3sw@mail.gmail.com>
From: Jayesh Senjaliya <jhsonline@gmail.com>
Date: Thu, 19 Jan 2017 22:54:51 -0800
Message-ID: <CADFdJVWnSvzpwKVX6yMc1NWr-wkXH7PSDLvuZ2Gp=2nCKZxVhw@mail.gmail.com>
Subject: Re: New book covers Airflow with PySpark: Agile Data Science 2.0
 (O'Reilly, 2017) AND Airflow Meetup?
To: dev@airflow.incubator.apache.org
Content-Type: multipart/alternative; boundary=94eb2c1239ea2e1d850546812240
archived-at: Fri, 20 Jan 2017 07:37:58 -0000

--94eb2c1239ea2e1d850546812240
Content-Type: text/plain; charset=UTF-8

Hi Siddharth,

I am Jayesh from Paypal, and at last meetup we briefly talked about
hosting next one and I offered to host next Airflow meetup at Paypal office.

If we can come up with some dates, I can talk to facilities and reserve
space accordingly.

Please let me know.

Thanks
Jayesh


On Thu, Jan 19, 2017 at 6:58 PM, siddharth anand <sanand@apache.org> wrote:

> Mid-March might be a good time given that we had 2 meet-ups recently.
>
> We have a wiki about Airflow meet-ups :
> https://cwiki.apache.org/confluence/display/AIRFLOW/Meetups. Feel free to
> ask this list if someone would like to host......I'd imagine interest would
> primarily come from other members of the community, but we're open to all
> ideas. Since the last meet-up was in SF, it would be great if the next one
> were in the South Bay.
>
> -s
>
> On Thu, Jan 19, 2017 at 6:46 PM, Russell Jurney <russell.jurney@gmail.com>
> wrote:
>
> > Siddharth, nice to hear from you. Great to hear!
> >
> > I'm just starting a consultancy called Data Syndrome around the book,
> and I
> > work from home, which doesn't put me in a great position to personally
> host
> > the meetup. If you need someone to organize it and to seek a venue, I can
> > do that. How does that sound? I'm sure I could find someone to host it.
> >
> > When would be a good date, do you think? Late February?
> >
> > On Thu, Jan 19, 2017 at 5:19 PM, siddharth anand <sanand@apache.org>
> > wrote:
> >
> > > Sounds like a great idea. We are looking for someone to host the next
> > one..
> > > once one is announced, you can sign up as a speaker.. You are also
> > welcome
> > > to host a meet-up if you like.
> > > -s
> > >
> > > On Thu, Jan 19, 2017 at 4:39 PM, Russell Jurney <
> > russell.jurney@gmail.com>
> > > wrote:
> > >
> > > > Hello! My name is Russell Jurney. I am a relatively new Airflow user
> > and
> > > > just joined the group. I am an Azkaban refugee, and an enemy of Oozie
> > and
> > > > the tyranny of XML.
> > > >
> > > > I wanted to tell you about my new book, out in pre-release, called
> > Agile
> > > > Data Science 2.0 <http://bit.ly/agile_data_science> (O'Reilly 2017).
> > In
> > > > the
> > > > book, we use Airflow in chapter 2, Setup, in a way similar to the
> > Airflow
> > > > tutorial. Then, in chapter 8, Deploying Predictive Systems, we use
> > > Airflow
> > > > to deploy a predictive system built with PySpark and Spark MLlib.
> > > >
> > > > Some highlights in the code at http://github.com/rjurney/
> > > Agile_Data_Code_2
> > > > :
> > > >
> > > >    - ch02/airflow_test.py
> > > >    <https://github.com/rjurney/Agile_Data_Code_2/blob/master/
> > > > ch02/airflow_test.py>
> > > > is
> > > >    a complete Airflow/PySpark tutorial along with
> > > ch02/pyspark_task_one.py
> > > >    <https://github.com/rjurney/Agile_Data_Code_2/blob/master/
> > > > ch02/pyspark_task_one.py>
> > > > and
> > > >    ch02/pyspark_task_two.py
> > > >    <https://github.com/rjurney/Agile_Data_Code_2/blob/master/
> > > > ch02/pyspark_task_two.py>
> > > >    - The airflow setup for chapter 8 is at ch08/airflow/setup.py
> > > >    <https://github.com/rjurney/Agile_Data_Code_2/blob/master/
> > > > ch08/airflow/setup.py>
> > > >    .
> > > >    - The scripts that it operates on are in ch08/
> > > >    <https://github.com/rjurney/Agile_Data_Code_2/blob/master/ch08>
> and
> > > > show
> > > >    things like how to use '{{ ds }}' and other parameters to hook
> your
> > > > scripts
> > > >    into 'airflow backfill' and other features.
> > > >    - ch08/make_predictions.py
> > > >    <https://github.com/rjurney/Agile_Data_Code_2/blob/master/
> > > > ch08/make_predictions.py>
> > > > shows
> > > >    how to setup a PySpark environment in a script in a way that can
> > work
> > > > with
> > > >    Airflow.
> > > >
> > > > If there is any interest, I would love to present on something like
> > > > "Building Predictive Systems with Spark and Airflow" at an upcoming
> > > Airflow
> > > > meetup.
> > > >
> > > > Thanks!
> > > > --
> > > > Russell Jurney twitter.com/rjurney russell.jurney@gmail.com
> relato.io
> > > >
> > >
> >
> >
> >
> > --
> > Russell Jurney twitter.com/rjurney russell.jurney@gmail.com relato.io
> >
>

--94eb2c1239ea2e1d850546812240--