Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3D80DCEDF for ; Thu, 11 Dec 2014 17:12:39 +0000 (UTC) Received: (qmail 80544 invoked by uid 500); 11 Dec 2014 17:12:39 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 80489 invoked by uid 500); 11 Dec 2014 17:12:39 -0000 Mailing-List: contact dev-help@flink.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.incubator.apache.org Delivered-To: mailing list dev@flink.incubator.apache.org Received: (qmail 80478 invoked by uid 99); 11 Dec 2014 17:12:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Dec 2014 17:12:39 +0000 X-ASF-Spam-Status: No, hits=-1997.8 required=5.0 tests=ALL_TRUSTED,HTML_MESSAGE,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Thu, 11 Dec 2014 17:12:13 +0000 Received: (qmail 79200 invoked by uid 99); 11 Dec 2014 17:12:11 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Dec 2014 17:12:11 +0000 Received: from mail-qa0-f43.google.com (mail-qa0-f43.google.com [209.85.216.43]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 9E1ED1A0041 for ; Thu, 11 Dec 2014 17:12:10 +0000 (UTC) Received: by mail-qa0-f43.google.com with SMTP id bm13so3823993qab.2 for ; Thu, 11 Dec 2014 09:12:08 -0800 (PST) X-Received: by 10.229.53.133 with SMTP id m5mr21952511qcg.28.1418317928111; Thu, 11 Dec 2014 09:12:08 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.49.7 with HTTP; Thu, 11 Dec 2014 09:11:47 -0800 (PST) In-Reply-To: References: <1272f302254944fa81f7a49316a1fde2@EX-MBX01.tubit.win.tu-berlin.de> <61458A5C-B6DA-429E-B871-7EAA6803E099@tu-berlin.de> From: Robert Metzger Date: Thu, 11 Dec 2014 18:11:47 +0100 Message-ID: Subject: Re: Streaming windowing rework To: "dev@flink.incubator.apache.org" Content-Type: multipart/alternative; boundary=001a1133da3248b0270509f3e0db X-Virus-Checked: Checked by ClamAV on apache.org --001a1133da3248b0270509f3e0db Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Thank you Gyula. Can you past the document contents into our wiki? On Thu, Dec 11, 2014 at 1:58 PM, Gyula F=C3=B3ra wro= te: > Hey all, > > For tomorrow's hangout Paris wrote us a nice summary of our current plans > for the streaming api. > > You can find it here: > > https://docs.google.com/document/d/1qwhELe_sc3acULAC9bwRCTAcvmoriU5Cb727L= WPOK0s/edit > > It would be helpful if everyone could go through the points so it is easi= er > to discuss afterwards. Feel free to add any comments even before the > hangout. > > We will post a hangout link too eventually :D > > Cheers, > Gyula > > > On Mon, Dec 8, 2014 at 8:10 PM, Henry Saputra > wrote: > > > HI Paris, this is great news! > > > > Thanks for the confirmation of time =3D) > > > > On Mon, Dec 8, 2014 at 3:22 AM, Paris Carbone > > wrote: > > > Hey, > > > > > > @Gyula I can help with the discussion content doc > > > @Gianmarco It will be great to have you! We will also keep you posted > on > > the Samoa integration. > > > @Henry, correct, it=E2=80=99s 8:30am PST. > > > > > > cheers > > > Paris > > > > > > > > >> On 08 Dec 2014, at 11:34, Gyula Fora wrote: > > >> > > >> Hey, > > >> > > >> I=E2=80=99m glad that you want to join. We will post a hangout link = here later > > :) > > >> > > >> Can someone please help me with setting these things up? > > >> > > >> Cheers, > > >> Gyula > > >> > > >>> On 08 Dec 2014, at 11:16, Gianmarco De Francisci Morales < > > gdfm@apache.org> wrote: > > >>> > > >>> Hi, > > >>> I'm one of the developers of SAMOA and I'd be happy to participate = as > > well. > > >>> How should I connect? > > >>> > > >>> Thanks, > > >>> > > >>> > > >>> -- > > >>> Gianmarco > > >>> > > >>> On 8 December 2014 at 09:28, Asterios Katsifodimos < > > >>> asterios.katsifodimos@tu-berlin.de> wrote: > > >>> > > >>>> Great work, +1 for Friday! > > >>>> > > >>>> Cheers, > > >>>> Asterios > > >>>>> On 08 Dec 2014, at 00:31, Henry Saputra > > wrote: > > >>>>> > > >>>>> Thanks Gyula, > > >>>>> > > >>>>> Just checking it will be 8:30am PST? > > >>>>> > > >>>>> To make it more productive please have some kind of simple design > > doc or > > >>>>> proposal with preso style to help us discuss each proposed work. > > >>>>> > > >>>>> Following the apache way, we then need to create Jira ticket and > > attach > > >>>> it > > >>>>> for other whom cannot attend the hangout to review and chime in. > > >>>>> Any Final decisions need to happen in dev list via emails or > > comments in > > >>>>> Jira. > > >>>>> > > >>>>> On Sunday, December 7, 2014, Paris Carbone wrote: > > >>>>> > > >>>>>> +1 > > >>>>>> > > >>>>>> I agree it will be nice to discuss our upcoming directions and > ideas > > >>>> with > > >>>>>> anyone that is interested to give feedback. > > >>>>>> One suggested time for the hangout is next Friday 12 Dec. 17:30p= m > > >>>> (GMT+1). > > >>>>>> I hope it is cross-atlantic friendly enough. Is that generally o= k > > for > > >>>> the > > >>>>>> rest? > > >>>>>> > > >>>>>> Paris > > >>>>>> > > >>>>>> PS: thanks for the hilarious introduction of the windowing > semantics > > >>>>>> everyone :) > > >>>>>> > > >>>>>> ________________________________________ > > >>>>>> From: Kostas Tzoumas [ktzoumas@apache.org ] > > >>>>>> Sent: Sunday, December 07, 2014 1:23 PM > > >>>>>> To: dev@flink.incubator.apache.org > > >>>>>> Subject: Re: Streaming windowing rework > > >>>>>> > > >>>>>> +1 great idea > > >>>>>> > > >>>>>> On Sun, Dec 7, 2014 at 10:35 AM, Gyula F=C3=B3ra > >>>>>> > wrote: > > >>>>>> > > >>>>>>> Hey Henry, > > >>>>>>> > > >>>>>>> (I am resending this mail because it seems it didnt make it > > through the > > >>>>>>> mail system) > > >>>>>>> > > >>>>>>> I suggest to have a public hangout sometimes on the current wor= k > > we are > > >>>>>>> doing and our plans on streaming. > > >>>>>>> > > >>>>>>> We have actually put together a list of topics that we want to > > work on > > >>>>>> next > > >>>>>>> year as we will have a quite large Flink team at SICS from > January: > > >>>>>> Paris, > > >>>>>>> Jonas, Me and later Vasia. > > >>>>>>> > > >>>>>>> Basically the topics are: > > >>>>>>> - Windowing semantics and multiquery optimisations (thats mainl= y > > Jonas' > > >>>>>>> thesis topic) > > >>>>>>> - Different fault tolerance approaches > > >>>>>>> - Connecting batch and streaming api ('lambda') > > >>>>>>> - Streaming graph algorithms > > >>>>>>> - Samoa for Flink (and streaming machine learning in general) > > >>>>>>> > > >>>>>>> So lets start a series of public hangout calls to discuss these > > >>>> topics, I > > >>>>>>> would suggest one sometimes next week when it is suitable. > > >>>>>>> > > >>>>>>> Regards, > > >>>>>>> Gyula > > >>>>>>> > > >>>>>>> On Sat, Dec 6, 2014 at 12:56 AM, Henry Saputra < > > >>>> henry.saputra@gmail.com > > >>>>>> > > > >>>>>>> wrote: > > >>>>>>> > > >>>>>>>> We actually need to bring these work come to light early so we > > could > > >>>>>>>> give feedback before getting to deep. > > >>>>>>>> > > >>>>>>>> Marton, could you encourage Paris and Jonas to publish or shar= e > > their > > >>>>>>>> thoughts about the work they are doing? > > >>>>>>>> > > >>>>>>>> Would love to give some feedbacks. > > >>>>>>>> > > >>>>>>>> - Henry > > >>>>>>>> > > >>>>>>>> On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas < > > ktzoumas@apache.org > > >>>>>> > > > >>>>>>>> wrote: > > >>>>>>>>> Super! > > >>>>>>>>> > > >>>>>>>>> Paris and Jonas have been doing a lot of "silent" work (=3D n= ot > > very > > >>>>>>>> visible > > >>>>>>>>> in the mailing list) recently. Looking forward to seeing this > > coming > > >>>>>>> in. > > >>>>>>>>> > > >>>>>>>>> On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra < > > >>>>>> henry.saputra@gmail.com > > >>>>>>>> > > >>>>>>>>> wrote: > > >>>>>>>>> > > >>>>>>>>>> Nice! Looking forward to it > > >>>>>>>>>> > > >>>>>>>>>> On Fri, Dec 5, 2014 at 9:34 AM, M=C3=A1rton Balassi < > > >>>>>>>> balassi.marton@gmail.com > > > >>>>>>>>>> wrote: > > >>>>>>>>>>> Hey, > > >>>>>>>>>>> > > >>>>>>>>>>> As you may know in some European countries Santa Claus come= s > on > > >>>>>> the > > >>>>>>>> 6th > > >>>>>>>>>> of > > >>>>>>>>>>> December, Saint Nicolas Day - from Finland. > > >>>>>>>>>>> > > >>>>>>>>>>> As Flink is not yet very active in Finland our Sweden team > > stepped > > >>>>>>> in > > >>>>>>>> and > > >>>>>>>>>>> gave us a big present with a huge rework on the windowing > > >>>>>> semantics > > >>>>>>> - > > >>>>>>>>>> this > > >>>>>>>>>>> is the implementation of the ideas that were posed the > > Stockholm > > >>>>>>>>>> hackathon > > >>>>>>>>>>> in October. > > >>>>>>>>>>> > > >>>>>>>>>>> Big thanks to Jonas, Paris and Gyula. Jonas is posting a > > detailed > > >>>>>>>> intro > > >>>>>>>>>> to > > >>>>>>>>>>> the new features here soon. > > >>>>>>>>>>> > > >>>>>>>>>>> Marton > > >>>>>>>>>> > > >>>>>>>> > > >>>>>>> > > >>>>>> > > >>>> > > >>>> > > >> > > > > > > --001a1133da3248b0270509f3e0db--