Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5ADAA200BC0 for ; Tue, 15 Nov 2016 22:10:00 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 57E81160B16; Tue, 15 Nov 2016 21:10:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id C854F160AF2 for ; Tue, 15 Nov 2016 22:09:59 +0100 (CET) Received: (qmail 7498 invoked by uid 500); 15 Nov 2016 21:09:59 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 7465 invoked by uid 99); 15 Nov 2016 21:09:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 15 Nov 2016 21:09:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id E21D62C0059 for ; Tue, 15 Nov 2016 21:09:58 +0000 (UTC) Date: Tue, 15 Nov 2016 21:09:58 +0000 (UTC) From: "sunjincheng (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FLINK-4937) Add incremental group window aggregation for streaming Table API MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 15 Nov 2016 21:10:00 -0000 [ https://issues.apache.org/jira/browse/FLINK-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668332#comment-15668332 ] sunjincheng commented on FLINK-4937: ------------------------------------ done > Add incremental group window aggregation for streaming Table API > ---------------------------------------------------------------- > > Key: FLINK-4937 > URL: https://issues.apache.org/jira/browse/FLINK-4937 > Project: Flink > Issue Type: Sub-task > Components: Table API & SQL > Affects Versions: 1.2.0 > Reporter: Fabian Hueske > Assignee: sunjincheng > > Group-window aggregates for streaming tables are currently not done in an incremental fashion. This means that the window collects all records and performs the aggregation when the window is closed instead of eagerly updating a partial aggregate for every added record. Since records are buffered, non-incremental aggregation requires more storage space than incremental aggregation. > The DataStream API which is used under the hood of the streaming Table API features [incremental aggregation|https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/windows.html#windowfunction-with-incremental-aggregation] using a {{ReduceFunction}}. > We should add support for incremental aggregation in group-windows. > This is a follow-up task of FLINK-4691. -- This message was sent by Atlassian JIRA (v6.3.4#6332)