Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 3CA0A200C6B for ; Tue, 18 Apr 2017 06:53:17 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 3B2B4160BAE; Tue, 18 Apr 2017 04:53:17 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7C559160BAB for ; Tue, 18 Apr 2017 06:53:16 +0200 (CEST) Received: (qmail 11426 invoked by uid 500); 18 Apr 2017 04:53:15 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 11416 invoked by uid 99); 18 Apr 2017 04:53:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Apr 2017 04:53:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 00240C0B41 for ; Tue, 18 Apr 2017 04:53:15 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.002 X-Spam-Level: X-Spam-Status: No, score=-0.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 8L9mN5404HZT for ; Tue, 18 Apr 2017 04:53:12 +0000 (UTC) Received: from proxy.tng.vnc.biz (zimbra-vnc.tngtech.com [83.144.240.98]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 512BA60DA5 for ; Tue, 18 Apr 2017 04:53:12 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by proxy.tng.vnc.biz (Postfix) with ESMTP id 0A4F51E1998 for ; Tue, 18 Apr 2017 06:53:06 +0200 (CEST) Received: from proxy.tng.vnc.biz ([127.0.0.1]) by localhost (proxy.tng.vnc.biz [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id Cuv3-cMimf21 for ; Tue, 18 Apr 2017 06:53:05 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by proxy.tng.vnc.biz (Postfix) with ESMTP id E8BD81E19C4 for ; Tue, 18 Apr 2017 06:53:04 +0200 (CEST) X-Virus-Scanned: amavisd-new at Received: from proxy.tng.vnc.biz ([127.0.0.1]) by localhost (proxy.tng.vnc.biz [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id U1AoZpY14lCz for ; Tue, 18 Apr 2017 06:53:04 +0200 (CEST) Received: from [192.168.0.16] (85.233.41.214.dynamic.cablesurf.de [85.233.41.214]) by proxy.tng.vnc.biz (Postfix) with ESMTPSA id B7FCC1E1998 for ; Tue, 18 Apr 2017 06:53:04 +0200 (CEST) Subject: Re: Window Functions and Empty Panes To: user@flink.apache.org References: From: Konstantin Knauf Message-ID: Date: Tue, 18 Apr 2017 06:53:03 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="f5loW8VFmMAQA6orOm3T1FnvouQd1A8bA" archived-at: Tue, 18 Apr 2017 04:53:17 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --f5loW8VFmMAQA6orOm3T1FnvouQd1A8bA Content-Type: multipart/mixed; boundary="SNwQjAVJwl3EA79IrKKLD0XBrj68EOoCn"; protected-headers="v1" From: Konstantin Knauf To: user@flink.apache.org Message-ID: Subject: Re: Window Functions and Empty Panes References: In-Reply-To: --SNwQjAVJwl3EA79IrKKLD0XBrj68EOoCn Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Ryan, afaik there is no way to override this behaviour. Did you have a look at the ProcessFunction [1]? Depending on your specific requirements you might be able to re-implement the desired functionality on top of it, but you will have to do all the time-handling yourself and you do not have window-scoped state. Cheers, Konstantin [1] https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/stream/pr= ocess_function.html On 18.04.2017 01:49, Ryan Conway wrote: > Hello Flinkers, >=20 > Is there a means of configuring a windowed stream such that its window > function is invoked for empty panes? >=20 > Looking at the source of WindowOperator in Flink 1.2.0 (line 473), I se= e > that the user's window function is invoked only when the pane isn't > empty. I am hoping for a means of overriding this behavior. >=20 > Alternatively... is there another mean of creating a stream with a > periodic output based on each period's inputs and some stored state? >=20 > Thank you, > Ryan --=20 Konstantin Knauf * konstantin.knauf@tngtech.com * +49-174-3413182 TNG Technology Consulting GmbH, Betastr. 13a, 85774 Unterf=C3=B6hring Gesch=C3=A4ftsf=C3=BChrer: Henrik Klagges, Christoph Stock, Dr. Robert Da= hlke Sitz: Unterf=C3=B6hring * Amtsgericht M=C3=BCnchen * HRB 135082 --SNwQjAVJwl3EA79IrKKLD0XBrj68EOoCn-- --f5loW8VFmMAQA6orOm3T1FnvouQd1A8bA Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEETCLf6qxSSGOKvAz/6J1RjKOgp1kFAlj1m68ACgkQ6J1RjKOg p1mCuQ/9FAi1QMnong/3fZGDb6YB2P9akr7+uHBbSi9WQ+S2bClOamxTQ0Fj3iuz tZNo7eiEjdzjvfJ5Q7fkLxAdXCQhV/Ml8RXhCIfs+WLc0I2pipoLNcAJv/uCMkWP pRojsZ/fI9feTyS0/xJjYXVZosyI2w0a+G+wrUimEtXwWypeJakLm8bR8PDJWcFz ggYdLyNfCXbyL9l2ygXsADaZzeMnS1oood+7KDq4coxMJO2Aau2ioOrvnLA00zUp GWq+iq61TktZ+4Y0qSCt25QHj1CJe15lutrSj0kJ8flh8u3yXGQ+a2A0VpsX/q7d t9npSKWC5v0kqn6CaSxU+FFhHDHTzp9X6PzSGfVBdEU7+6kFXoAuf3knlZgKeHVm wK1/4pFJKHG7VFUASHZQxP+5vIo8I4KC3S8XBRlAuTyi9kDUppl95FAhVvnArhhq qojN5xNCCe6LxafdAUQKwkgQnvRz4RVyapkqt2ZMTWRqVXs1INqftI9m0pAO0hpZ R+U9B8f6DVGyJvNpqfcAGJKyjDWCfrKy65wfLdnmbI6F/VRXg3XSOomAoTlRpeQc 1AgAdEGV5SYgP9ivWiw2UBKWDCiLx0Xe1vEOWE31RO+IIpgIak1H5zhaErfFU+uT v0AyWgZienm5IL94iHoKh8b8beJF6i/55ymUC1vO6xsIiTPviGc= =Rnog -----END PGP SIGNATURE----- --f5loW8VFmMAQA6orOm3T1FnvouQd1A8bA--