Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 606E1200CEF for ; Mon, 21 Aug 2017 05:20:06 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 5EBDE163DE8; Mon, 21 Aug 2017 03:20:06 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7DFCF163DDA for ; Mon, 21 Aug 2017 05:20:05 +0200 (CEST) Received: (qmail 36055 invoked by uid 500); 21 Aug 2017 03:20:03 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 36037 invoked by uid 99); 21 Aug 2017 03:20:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Aug 2017 03:20:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 4AE241806AB for ; Mon, 21 Aug 2017 03:20:03 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.151 X-Spam-Level: X-Spam-Status: No, score=-0.151 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.8, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id zIEniF6AoYFQ for ; Mon, 21 Aug 2017 03:20:01 +0000 (UTC) Received: from mail-pg0-f47.google.com (mail-pg0-f47.google.com [74.125.83.47]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id E9D875F6C8 for ; Mon, 21 Aug 2017 03:20:00 +0000 (UTC) Received: by mail-pg0-f47.google.com with SMTP id i12so91475826pgr.3 for ; Sun, 20 Aug 2017 20:20:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9VzmV+XRf1DU1rjn2hAVG/e0sNH9BWM7Sy6zDcU9kig=; b=AbSKNMvABaCWiSG7DXyNTZyewBTcRGV0YMtp9MYN0OrH7wS4jiR8pnlhtKELjfqKC6 2dl1wmkxNSRWuGExQMc1mAEDUvv4sJWfCdXkDljQyw6chMDonZxFxduDdDKsiz9zHKLF 73qQLUh/+8/JS8ucVaOVVqBDho1qZdoWBMW/V2ck3xx82W80AIGF+YEvuNSPriawQYfL bfcdaxjRQ0+GOHBazAlTUdCRcfSjtpy+36f0fnc242kqNB62/X1V8LrP00Anui+sBJa8 wvV9zb0HX/fTvLvYkpZ8pdj5WX289AuebKsS2BF/2h4/V6H0Inxk9Xr0CZ8Qx/4HyCQS +1Sg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9VzmV+XRf1DU1rjn2hAVG/e0sNH9BWM7Sy6zDcU9kig=; b=EgaHlOB+NT+JNOhOC42+Z+6WtZ/Sx8nk53GLaXL7At80m9xZbJ+DJ3te8YZAJDerFq VvH0mgUVn/oU1q6+6j36ST7N/3zHN+dTSMOixVDb0O6FxSXqY4TZIdYhy1zyDN+gxF1V bHywQo6n0b8u10wbmSsp+MNiVTbeGYxKtyr79643FpI1UAhMzIV+Yqcv9zkF2NCv4OID RXPaJXjQJvuiw2rC+0MKBFjOlkXsIqM70Tnyjuj8Yu+1Lby81IdH5oQjUop1KSWIcSTP 2DcIjc/ua/Vbk72aU55IluP6eJbpWEsnibjU3rA/dfW2D193DbAgrp9sJ5p6qaOt1RTm KfuQ== X-Gm-Message-State: AHYfb5gS3UF4ooXll6E+TNlP0SG/9GInO2XuZ2C6YlNCYAEuyIy+ZL/B Tc0gPByDxD2H+ZIW2pYU68pUq1/Kgg== X-Received: by 10.84.239.8 with SMTP id w8mr17175042plk.73.1503285599248; Sun, 20 Aug 2017 20:19:59 -0700 (PDT) MIME-Version: 1.0 References: <7de15d76.3088.15df99b306a.Coremail.18717838093@163.com> <46b962a5.3668.15df9efd16c.Coremail.18717838093@163.com> In-Reply-To: From: Renjie Liu Date: Mon, 21 Aug 2017 03:19:48 +0000 Message-ID: Subject: Re: Re: Just do a survey, how many people give up the storm and turn to Flink ? To: kaniska Mandal , Niels Basjes Cc: mingleizhang <18717838093@163.com>, user@flink.apache.org Content-Type: multipart/alternative; boundary="f4030436049223a81105573af423" archived-at: Mon, 21 Aug 2017 03:20:06 -0000 --f4030436049223a81105573af423 Content-Type: text/plain; charset="UTF-8" We are running both systems. Old existing systems are still running on storm and new jobs are all running on flink. On Mon, Aug 21, 2017 at 3:06 AM kaniska Mandal wrote: > Storm supports 'exactly once' - > http://storm.apache.org/releases/current/Trident-tutorial.html > > Storm supports 'stateful processing' - > http://storm.apache.org/releases/2.0.0-SNAPSHOT/State-checkpointing.html > > Storm is blazing fast - when its properly configured to use distributed > (via some client like redisson) and local cache. > > > > On Sun, Aug 20, 2017 at 11:27 AM, Niels Basjes wrote: > >> If you combine Storm with Redis for managing state you still do not have >> "exactly once" when a failure of a processing node occurs. >> With Flink you do have that. >> >> Niels >> >> On 19 Aug 2017 12:00, "mingleizhang" <18717838093@163.com> wrote: >> >>> Thanks Niels for your answer. Yes, storm does not support stateful >>> processing components. So, I have to use something like Redis to store it's >>> stateful. >>> >>> >>> >>> >>> >>> At 2017-08-19 16:57:13, "Niels Basjes" wrote: >>> >>> Hi, >>> >>> The company I work for switched about 2 years ago because of these >>> reasons AT THAT moment! >>> 1) Storm doesn't run on Yarn >>> 2) Storm doesn't support statefull processing components. >>> 3) Storm has a bad Java api. >>> 4) Storm is not fast enough. >>> >>> Some of these things have changed over the last 2 years. But comparing >>> the two at this moment would still let me choose Flink. >>> >>> Niels >>> >>> On 19 Aug 2017 10:28, "mingleizhang" <18717838093@163.com> wrote: >>> >>>> Hi, flink user >>>> >>>> I just want to do a survey as the subject said. How many of you >>>> that used to use *storm *as your real-time computing framework, but >>>> now, turn to Flink instead. And *why *? Could you tell me ? Thank you >>>> very much! >>>> >>>> Thanks >>>> zhangminglei >>>> >>>> >>>> >>>> >>>> >>> >>> >>> >>> >>> >> > -- Liu, Renjie Software Engineer, MVAD --f4030436049223a81105573af423 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
We are running both systems. Old existing systems are stil= l running on storm and new jobs are all running on flink.

On Mon, Aug 21, 2017 at 3:06 AM kaniska= Mandal <kaniska.mandal@gmai= l.com> wrote:

Storm is blazing fast - when its properly= configured to use distributed (via some client like redisson) and local ca= che.=C2=A0



On Sun, Aug 20, 2017 at 11:= 27 AM, Niels Basjes <niels@basj.es> wrote:
If you combine Storm wit= h Redis for managing state you still do not have "exactly once" w= hen a failure of a processing node occurs.
With Flink you = do have that.

Niels
<= /div>

On 19 = Aug 2017 12:00, "mingleizhang" <18717838093@163.com> wrote:
Thanks N= iels for your answer. Yes, storm does not support stateful processing compo= nents. So, I have to use something like Redis to store it's stateful.




At 2017-08-19 16:57:13, "Niels Basjes" <niels@basj.es> wrote:
Hi,

The company I work for switched about 2 year= s ago because of these reasons AT THAT moment!
1) St= orm doesn't run on Yarn
2) Storm doesn't sup= port statefull processing components.
3) Storm has a= bad Java api.
4) Storm is not fast enough.

Some of these things have change= d over the last 2 years. But comparing the two at this moment would still l= et me choose Flink.

Niel= s

On 1= 9 Aug 2017 10:28, "mingleizhang" <18717838093@163.com> wrote:
Hi, flink user
=C2=A0 =C2=A0=C2=A0
=C2=A0 =C2=A0 =C2= =A0I just want to do a survey as the subject said. How many of you that use= d to use storm as your real-time computing framework, but now, turn = to Flink instead. And why ? Could you tell me ? Thank you very much!=

Thanks
zhangminglei


=


=C2=A0




=C2=A0

<= /span>

--
Liu, Renjie
Software Engineer, MVAD
<= /div> --f4030436049223a81105573af423--