Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8115E1875F for ; Mon, 29 Jun 2015 09:15:03 +0000 (UTC) Received: (qmail 74670 invoked by uid 500); 29 Jun 2015 09:15:03 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 74617 invoked by uid 500); 29 Jun 2015 09:15:03 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 74593 invoked by uid 99); 29 Jun 2015 09:15:03 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Jun 2015 09:15:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 9F70818275B for ; Mon, 29 Jun 2015 09:15:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id PKaZJGR8FkdJ for ; Mon, 29 Jun 2015 09:15:01 +0000 (UTC) Received: from mail-la0-f53.google.com (mail-la0-f53.google.com [209.85.215.53]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 61E8945417 for ; Mon, 29 Jun 2015 09:15:01 +0000 (UTC) Received: by lagc2 with SMTP id c2so1986844lag.3 for ; Mon, 29 Jun 2015 02:14:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :content-type; bh=BLoKU0rbMqWYABuS1ii5khzJJtf7kQAXf+FNL2Usi9A=; b=NBFjp+6x7BqiOvWbq7oTgxjLKcab8f9jjX8pHjBky5zOG2tYz7moKtCYPMe05J/sBb FVMVar7H8o00p1D/MHFDeYsD+GMA5ebuTecoIv1Je5JTxLVmSr51qRihcjl+r2c5Litv 97Wy4x34yn2zt9INqd/RYG1gfejIteNKGan2GSL0KHasgi+1zgeQtxseEvg9hiVl1yeT lGk5pkGCAACVi9Vs27Cox6hLnZ1IqSzcTcnGAGMVUqGUUSkKgdr/FmgrESROzs2Mx4qd /e7VXH5G7JlLNjxrvr/KaWIpRO8+LBf4chDMHvNF4MkqygjcD7TJPWiMq1VefmanRSi+ GCnQ== X-Received: by 10.112.137.99 with SMTP id qh3mr13188534lbb.108.1435569294130; Mon, 29 Jun 2015 02:14:54 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?Q?Gyula_F=C3=B3ra?= Date: Mon, 29 Jun 2015 09:14:44 +0000 Message-ID: Subject: Re: Off-by-one issues in the windowing code To: dev@flink.apache.org Content-Type: multipart/alternative; boundary=089e0118279cd3c6ba0519a48582 --089e0118279cd3c6ba0519a48582 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable The second issue is related to parallel time based aggregations. I think we should fix this for 0.9.1. Also since the fix as you said is rather straight-forward there is no harm doing it. As I understand if we keep the functionality of having time based global windows, the implementations for merging the partial aggregates will be conceptually similar after Aljoscha's update as well. M=C3=A1rton Balassi ezt =C3=ADrta (id=C5=91pont:= 2015. j=C3=BAn. 29., H, 11:02): > I have found two off-by-one issues in the windowing code. > > The first may result in duplicate data in the last window and is easy to > fix. [1] > > The second may result data being swallowed in the last window, and is als= o > not difficult to fix. [2] > > I've talked to Aljoscha about fixing the second one, and he suggested not > to fix it right away as that part should be rewritten soon anyways, maybe > we remove that functionality as a whole. As this is also in the 0.9.0 > release I would still opt for having it, at least for the sake of 0.9.1. > > What do you think? > > [1] https://issues.apache.org/jira/browse/FLINK-2285 > [2] https://issues.apache.org/jira/browse/FLINK-2286 > > Best, > > Marton > --089e0118279cd3c6ba0519a48582--