Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id E4902200BCA for ; Mon, 21 Nov 2016 21:04:43 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id E3633160AEF; Mon, 21 Nov 2016 20:04:43 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id CECCB160AF9 for ; Mon, 21 Nov 2016 21:04:42 +0100 (CET) Received: (qmail 39389 invoked by uid 500); 21 Nov 2016 20:04:42 -0000 Mailing-List: contact commits-help@beam.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.incubator.apache.org Delivered-To: mailing list commits@beam.incubator.apache.org Received: (qmail 39380 invoked by uid 99); 21 Nov 2016 20:04:42 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Nov 2016 20:04:42 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 82C2AC16E8 for ; Mon, 21 Nov 2016 20:04:41 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -6.769 X-Spam-Level: X-Spam-Status: No, score=-6.769 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, KAM_LOTSOFHASH=0.25, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id aglC_TlRzy82 for ; Mon, 21 Nov 2016 20:04:39 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with SMTP id 4ADEA5F39A for ; Mon, 21 Nov 2016 20:04:39 +0000 (UTC) Received: (qmail 37221 invoked by uid 99); 21 Nov 2016 20:03:23 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 21 Nov 2016 20:03:23 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id BD3D6E0999; Mon, 21 Nov 2016 20:03:23 +0000 (UTC) From: kennknowles To: commits@beam.incubator.apache.org Reply-To: commits@beam.incubator.apache.org Message-ID: Subject: [GitHub] incubator-beam pull request #1399: [BEAM-25] Direct runner state Content-Type: text/plain Date: Mon, 21 Nov 2016 20:03:23 +0000 (UTC) archived-at: Mon, 21 Nov 2016 20:04:44 -0000 GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1399 [BEAM-25] Direct runner state Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [x] Replace `` in the title with the actual Jira issue number, if there is one. - [x] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/kennknowles/incubator-beam DirectRunner-state Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1399.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1399 ---- commit 9d35e9f715f2c76ae54f3b304e41d1dbdf8c0f92 Author: Kenneth Knowles Date: 2016-11-16T05:33:01Z Reject stateful DoFn in ApexRunner commit aab81549a70d1ac3f6580f66759566f673c243b8 Author: Kenneth Knowles Date: 2016-11-16T05:33:13Z Reject stateful DoFn in SparkRunner commit 0c2aa666ecaf7def9fa28c6dc81b90c3ad0dc873 Author: Kenneth Knowles Date: 2016-11-16T05:33:28Z Reject stateful DoFn in FlinkRunner commit ec12dd3102d0a76e5b4cf7ad0a503b746e165d01 Author: Kenneth Knowles Date: 2016-11-16T05:35:03Z Reject stateful DoFn in DataflowRunner commit a66e71fb92734f6d423ce9ee012812322992ba40 Author: Kenneth Knowles Date: 2016-11-10T05:10:51Z Add State parameter support to SimpleDoFnRunner commit 8a058b14ab4084ee122d396f96ef2b76d86d3368 Author: Kenneth Knowles Date: 2016-11-21T19:34:45Z Remove overspecified type in ParDoEvaluator commit 677155a6148ea383065c1792db49e283e466cef1 Author: Kenneth Knowles Date: 2016-11-10T05:59:15Z Add support for Stateful ParDo in the Direct runner This adds overrides and new evaluators to ensure that state is accessed in a single-threaded manner per key and is cleaned up when a window expires. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastructure@apache.org or file a JIRA ticket with INFRA. ---