Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1F6B0200CB0 for ; Fri, 19 May 2017 01:30:19 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1DF56160BB5; Thu, 18 May 2017 23:30:19 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 64D0F160BD0 for ; Fri, 19 May 2017 01:30:18 +0200 (CEST) Received: (qmail 65869 invoked by uid 500); 18 May 2017 23:30:17 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 65711 invoked by uid 99); 18 May 2017 23:30:16 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 May 2017 23:30:16 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 7A428E10F8; Thu, 18 May 2017 23:30:16 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: jkff@apache.org To: commits@beam.apache.org Date: Thu, 18 May 2017 23:30:19 -0000 Message-Id: <64bfffbea54b473ab969028aa65be978@git.apache.org> In-Reply-To: <85cb7f8c71fe4081b2740590febd5815@git.apache.org> References: <85cb7f8c71fe4081b2740590febd5815@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [4/4] beam git commit: This closes #3156 archived-at: Thu, 18 May 2017 23:30:19 -0000 This closes #3156 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c93b3aa3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c93b3aa3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c93b3aa3 Branch: refs/heads/master Commit: c93b3aa3d2081558a776fa12c564efb5f15090ab Parents: 2e0cf00 7a2e829 Author: Eugene Kirpichov Authored: Thu May 18 16:15:00 2017 -0700 Committer: Eugene Kirpichov Committed: Thu May 18 16:15:00 2017 -0700 ---------------------------------------------------------------------- .../apache/beam/runners/apex/ApexRunner.java | 7 +- .../translation/ApexPipelineTranslator.java | 11 +- .../apex/translation/ParDoTranslator.java | 11 +- .../operators/ApexParDoOperator.java | 10 +- .../construction/ElementAndRestriction.java | 42 ++ .../ElementAndRestrictionCoder.java | 88 +++ .../core/construction/SplittableParDo.java | 298 +++++++++ .../ElementAndRestrictionCoderTest.java | 126 ++++ .../core/construction/SplittableParDoTest.java | 157 +++++ .../apache/beam/runners/core/DoFnRunners.java | 2 +- .../runners/core/ElementAndRestriction.java | 42 -- .../core/ElementAndRestrictionCoder.java | 88 --- .../beam/runners/core/ProcessFnRunner.java | 7 +- .../beam/runners/core/SplittableParDo.java | 602 ------------------ .../core/SplittableParDoViaKeyedWorkItems.java | 418 +++++++++++++ .../core/ElementAndRestrictionCoderTest.java | 127 ---- .../core/SplittableParDoProcessFnTest.java | 515 ++++++++++++++++ .../beam/runners/core/SplittableParDoTest.java | 606 ------------------- ...ectGBKIntoKeyedWorkItemsOverrideFactory.java | 9 +- .../beam/runners/direct/DirectRunner.java | 10 +- .../direct/KeyedPValueTrackingVisitor.java | 4 +- .../direct/ParDoMultiOverrideFactory.java | 2 +- ...littableProcessElementsEvaluatorFactory.java | 11 +- .../direct/TransformEvaluatorRegistry.java | 4 +- .../flink/FlinkStreamingPipelineTranslator.java | 7 +- .../FlinkStreamingTransformTranslators.java | 29 +- .../streaming/SplittableDoFnOperator.java | 12 +- 27 files changed, 1721 insertions(+), 1524 deletions(-) ----------------------------------------------------------------------