Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A73EC200B99 for ; Wed, 21 Sep 2016 01:15:51 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A5F26160AD6; Tue, 20 Sep 2016 23:15:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id F193D160AC5 for ; Wed, 21 Sep 2016 01:15:50 +0200 (CEST) Received: (qmail 90657 invoked by uid 500); 20 Sep 2016 23:15:50 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 90648 invoked by uid 99); 20 Sep 2016 23:15:49 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Sep 2016 23:15:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9952EC00F7 for ; Tue, 20 Sep 2016 23:15:49 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -4.344 X-Spam-Level: X-Spam-Status: No, score=-4.344 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-1.124] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id q3U1djWGmO6F for ; Tue, 20 Sep 2016 23:15:47 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 895F65F484 for ; Tue, 20 Sep 2016 23:15:47 +0000 (UTC) Received: (qmail 90633 invoked by uid 99); 20 Sep 2016 23:15:47 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Sep 2016 23:15:47 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id E0FABE08F2; Tue, 20 Sep 2016 23:15:46 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: robertwb@apache.org To: commits@beam.incubator.apache.org Date: Tue, 20 Sep 2016 23:15:46 -0000 Message-Id: X-Mailer: ASF-Git Admin Mailer Subject: [1/2] incubator-beam git commit: Insert global windowing before write results GBK archived-at: Tue, 20 Sep 2016 23:15:51 -0000 Repository: incubator-beam Updated Branches: refs/heads/python-sdk acd8d7952 -> 701aff074 Insert global windowing before write results GBK Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/57a0b6af Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/57a0b6af Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/57a0b6af Branch: refs/heads/python-sdk Commit: 57a0b6af5ef6bde2ba4bb88fe47997f86c5d5e25 Parents: acd8d79 Author: Robert Bradshaw Authored: Tue Sep 20 15:24:31 2016 -0700 Committer: GitHub Committed: Tue Sep 20 15:24:31 2016 -0700 ---------------------------------------------------------------------- sdks/python/apache_beam/io/iobase.py | 1 + 1 file changed, 1 insertion(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/57a0b6af/sdks/python/apache_beam/io/iobase.py ---------------------------------------------------------------------- diff --git a/sdks/python/apache_beam/io/iobase.py b/sdks/python/apache_beam/io/iobase.py index ecb8a70..e1f364b 100644 --- a/sdks/python/apache_beam/io/iobase.py +++ b/sdks/python/apache_beam/io/iobase.py @@ -1032,6 +1032,7 @@ class WriteImpl(ptransform.PTransform): _WriteBundleDoFn(), self.sink, AsSingleton(init_result_coll)) | core.Map(lambda x: (None, x)) + | core.WindowInto(window.GlobalWindows()) | core.GroupByKey() | core.FlatMap(lambda x: x[1])) return do_once | core.FlatMap(