Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4045D190B4 for ; Wed, 27 Apr 2016 05:01:54 +0000 (UTC) Received: (qmail 55198 invoked by uid 500); 27 Apr 2016 05:01:54 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 55106 invoked by uid 500); 27 Apr 2016 05:01:54 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 55096 invoked by uid 99); 27 Apr 2016 05:01:53 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Apr 2016 05:01:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 393B4C3BE0 for ; Wed, 27 Apr 2016 05:01:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.189 X-Spam-Level: * X-Spam-Status: No, score=1.189 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.co.in Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 9f32mnk5y3OZ for ; Wed, 27 Apr 2016 05:01:50 +0000 (UTC) Received: from nm27-vm4.bullet.mail.sg3.yahoo.com (nm27-vm4.bullet.mail.sg3.yahoo.com [106.10.151.131]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id AB8A75F250 for ; Wed, 27 Apr 2016 05:01:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.co.in; s=s2048; t=1461733300; bh=hO2cMEtkpyKOYYR7EORNVFhvigjCYWEJhS4vLf3NXYE=; h=Date:From:Reply-To:To:In-Reply-To:References:Subject:From:Subject; b=gZJjGztD8+CY4pkRmWt3m2inm5W10ZA0m/MFYxQcBgdJEKyrabTus+8++gQxEMYckM8hOT8KdkE8FozX5U/UHgDdjWd4eZhDUamJsVB2VCnfU6NEsBof90nCR0BYAbEBpePzc8v3Dmoor4tlNbnndsGLKNgvJ27KRwaSzt9/W4NUyP+i0q43M25kReT1CBTb1lTkRgWeXZ1hXAS8eSNBG4Hgw/Vqtm4L2JchBDHkk2h1NTfWrFSBDjfTkjGk9UX9Ox1gphmyGXDi7WetO/i+GWBxMxQPfC9k0TKZ880dXbUl2fL96EXf8gFpVdOcK8gchdBgwsVqf43KKvwatyJwUQ== Received: from [106.10.166.119] by nm27.bullet.mail.sg3.yahoo.com with NNFMP; 27 Apr 2016 05:01:40 -0000 Received: from [106.10.151.253] by tm8.bullet.mail.sg3.yahoo.com with NNFMP; 27 Apr 2016 05:01:40 -0000 Received: from [127.0.0.1] by omp1002.mail.sg3.yahoo.com with NNFMP; 27 Apr 2016 05:01:40 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 745931.59017.bm@omp1002.mail.sg3.yahoo.com X-YMail-OSG: 6XE0bU8VM1mHxVfLPvvmrsIRcE3OPmjlZkJPAjQph6tQGagmbVPEfOPQU8fouX8 4isp.ZcJTBO2HfsencVBRuaMp8yYjCwlkKDJTV3t.sTn0MPmCOTlQxO_qzzDNq6AdMVtB4yJyEWT dYEbYyX5neXJsfWECoAotm9cmViBMt3ogYOq3_iEUuDOIZOJyvyScUjV9H8rp7h6ukYYP_xfjF86 gBPdaS0z34raMZep5EtLJCjXefeQSvtykkHpYID6Zollv5iyqmU68TNOjYLyyFktCjvLfy8sL2LR z.1zm7kPN.W.5DviT6f1qZFe.v_prvnL4SmmGwU4W_QyNkM8ambbZfDF4k2BYNn2jvX2XZ_BA1Tl 7JTcosj9OLYDI08QjN_Kn4sQMmw0V2WUSkEgQB_yMTDx8j9WU1t2HG6XTsEfUtN31aTLg2nz7HEg wWAZCKa6CcyUj7x9XQ6qax3aUnReIrYC47aUDcbs7V7t.SJbLjFOFElKa6A_l.FjCw4g7N0jCC2S ua8VBWKx9JREMC_QlGVdt4TalCAT.OZsMDvM- Received: by 106.10.196.179; Wed, 27 Apr 2016 05:01:40 +0000 Date: Wed, 27 Apr 2016 05:01:39 +0000 (UTC) From: Piyush Shrivastava Reply-To: Piyush Shrivastava To: Dominik Choma , "user@flink.apache.org" Message-ID: <885253673.2112015.1461733299986.JavaMail.yahoo@mail.yahoo.com> In-Reply-To: References: <1791090076.1817102.1461665781693.JavaMail.yahoo.ref@mail.yahoo.com> <1791090076.1817102.1461665781693.JavaMail.yahoo@mail.yahoo.com> Subject: Re: Understanding Sliding Windows MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_2112014_2077894882.1461733299976" ------=_Part_2112014_2077894882.1461733299976 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello Dominik, Thanks for the information. Since my window is getting triggered every 10 s= econds, the results I am getting before 5 minutes would be irrelevant as I = need to consider data coming in every 5 minutes. Is there a way I can skip = the results that are output before the first 5 minutes? Thanks and Regards,Piyush Shrivastava http://webograffiti.com =20 On Tuesday, 26 April 2016 8:54 PM, Dominik Choma wrote: =20 Piyush, You created sliding window witch is triggered every 10 seconds Flink fires up this window every 10 seconds, without waiting at 5 min buffe= r to be filled up It seems to me that first argument is rather "maximum data buffer retention= " than " the initial threshold" Dominik Dominik 2016-04-26 12:16 GMT+02:00 Piyush Shrivastava : Hi all,I wanted to know how exactly sliding windows produce results in Flin= k.Suppose I create a sliding window of 5 minutes which is refreshed in ever= y 10 seconds: .timeWindow(Time.minutes(5), Time.seconds(10)) So in every 10 seconds we are looking at data from the past 5 minutes. But = what happens before the initial 5 minutes have passed?Suppose we start the = computation at 10:00. At 10:05 we will get the result for 10:00-10:05. But = what are the results which we get in between this? i.e. at 10:00:10, 10:00:= 20 and so on.Basically why do Flink start producing results before the init= ial threshold has passed? What do these results signify?=C2=A0Thanks and Re= gards,Piyush Shrivastava http://webograffiti.com ------=_Part_2112014_2077894882.1461733299976 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello Dominik,

<= /div>
Thanks for the inform= ation. Since my window is getting triggered every 10 seconds, the results I= am getting before 5 minutes would be irrelevant as I need to consider data= coming in every 5 minutes. Is there a way I can skip the results that are = output before the first 5 minutes?


On Tuesday, 26 April 2016 8:54 PM, Domin= ik Choma <dominik.choma@gmail.com> wrote:


=
Piyush,

You created sliding window witch is triggered every 10 seconds
Flink fires up this window every 10 seconds, without wait= ing at 5 min buffer to be filled up
It seems to me that first argument is rather "maximum data buffer = retention" than " the initial threshold"
Dominik



Dom= inik

2016-04-26 12:16 GMT+0= 2:00 Piyush Shrivastava <piyushjoy@yahoo.co.in>:
Hi all,=
I wanted to know how exactly sliding windows produc= e results in Flink.
Suppose I create a sliding windo= w of 5 minutes which is refreshed in every 10 seconds:

.timeWindow(Time.minutes= (5), Time.seconds(10))

So in every 10 seconds we are = looking at data from the past 5 minutes. But what happens before the initia= l 5 minutes have passed?
Suppose we star= t the computation at 10:00. At 10:05 we will get the result for 10:00-10:05= . But what are the results which we get in between this? i.e. at 10:00:10, = 10:00:20 and so on.
Basically why do Fli= nk start producing results before the initial threshold has passed? What do= these results signify?
 


------=_Part_2112014_2077894882.1461733299976--