Mailing-List: contact dev-help@flink.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.incubator.apache.org
Received-SPF: pass (athena.apache.org: domain of balassi.marton@gmail.com
 designates 209.85.215.54 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <EDC04C38-4F61-4E7E-B705-8355A3B4F727@kth.se>
References: 
 <CAJZ2dcUNfVWmHqwSoMiv=AyKo1uAcgy051-sT9uktUirXwsDJQ@mail.gmail.com>
 <CAJZ2dcXR8JF3UkcO35jEyVaXzJfGzkCk2FqTHTNiwDfH+jx8Rg@mail.gmail.com>
 <EDC04C38-4F61-4E7E-B705-8355A3B4F727@kth.se>
From: =?UTF-8?Q?M=C3=A1rton_Balassi?= <balassi.marton@gmail.com>
Date: Thu, 27 Nov 2014 15:19:19 +0100
Message-ID: 
 <CAKADb_MGC+m+wudXBkXghpizk-Q2Yf_ZUUO_29XFfV2x430c1g@mail.gmail.com>
Subject: Re: Samoa on Flink
To: dev@flink.incubator.apache.org
Content-Type: multipart/alternative; boundary=089e0158b9c6b847850508d7d51f

--089e0158b9c6b847850508d7d51f
Content-Type: text/plain; charset=UTF-8

Hey,

Thanks Vasia, great idea.
When we've started the streaming development the first sketch API we had is
was actually really similar to Storm's API a couple of versions back. I've
talked to Gyula about the issue when we've first heard about SAMOA ago and
we are confident that porting Samoa to Flink streaming shoul be definitely
managable and really useful as Paris mentions.

Luckily they have ASF2 license so the legal cooperation is clear. The rest
is on us and fortunately Paris might have a candidate already to kick off
the development. :)

Cheers,

Marton

On Thu, Nov 27, 2014 at 2:05 PM, Paris Carbone <parisc@kth.se> wrote:

> Hey Vasia,
>
> I really like the idea and it seems we have some volunteers from our side
> already!
> It is in my opinion a starter task since it requires to create a simple
> adapter for flink as well as mapping abstractions to our streaming topology
> API in a similar fashion (in its simplest form just using several flatmaps).
>
> It will serve as a suitable common layer to make some comparisons between
> flink-streaming to storm, s4 and samoa on incremental machine learning
> tasks.
>
> Paris
>
> > On 27 Nov 2014, at 13:59, Vasiliki Kalavri <vasilikikalavri@gmail.com>
> wrote:
> >
> > Hello everyone,
> >
> > Last week at Strata, I attended a talk about a streaming machine learning
> > framework from Yahoo labs, SAMOA: https://github.com/yahoo/samoa. The
> > project is going through apache incubation application and currently runs
> > on Storm, S4 and Samza.
> >
> > After the talk, I spoke with the guy that presented it and we both
> thought
> > that it'd be cool to port Samoa on Flink.
> >
> > I'm writing about this here because I want to know your thoughts on this
> > and also because I'm not very familiar with the Streaming-API, so I will
> > need your input :)
> > I have already discussed with Paris and there is interest to pick this up
> > from some students at KTH as well.
> > As far as I understand, Samoa expects an API similar to that of Storm and
> > from there the integration should be pretty straight-forward.
> >
> > So, do you think it would be feasible and -most importantly- worth it?
> >
> > Cheers,
> > Vasia.
>
>

--089e0158b9c6b847850508d7d51f--