Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 961F4200C22 for ; Tue, 21 Feb 2017 18:56:49 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 94AA4160B68; Tue, 21 Feb 2017 17:56:49 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DE34B160B4F for ; Tue, 21 Feb 2017 18:56:48 +0100 (CET) Received: (qmail 59873 invoked by uid 500); 21 Feb 2017 17:56:48 -0000 Mailing-List: contact commits-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@beam.apache.org Delivered-To: mailing list commits@beam.apache.org Received: (qmail 59854 invoked by uid 99); 21 Feb 2017 17:56:48 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Feb 2017 17:56:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 89EA51A7AD9 for ; Tue, 21 Feb 2017 17:56:47 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.999 X-Spam-Level: X-Spam-Status: No, score=-1.999 tagged_above=-999 required=6.31 tests=[KAM_LAZY_DOMAIN_SECURITY=1, RP_MATCHES_RCVD=-2.999] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id nvyshf3-GYSy for ; Tue, 21 Feb 2017 17:56:46 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 3A1E95F56B for ; Tue, 21 Feb 2017 17:56:46 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id C92DAE0A12 for ; Tue, 21 Feb 2017 17:56:44 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 385302412D for ; Tue, 21 Feb 2017 17:56:44 +0000 (UTC) Date: Tue, 21 Feb 2017 17:56:44 +0000 (UTC) From: "ASF GitHub Bot (JIRA)" To: commits@beam.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (BEAM-646) Get runners out of the apply() MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 21 Feb 2017 17:56:49 -0000 [ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876397#comment-15876397 ] ASF GitHub Bot commented on BEAM-646: ------------------------------------- GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2055 [BEAM-646] Add a Base OverrideFactory class for 1-to-1 overrides Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- These overrides are relatively common, and this reduces the reimplementation of mapping singletons and casting them. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tgroh/beam one-to-one_overrides Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2055.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2055 ---- commit 1f15eba04c034e49feb34ff2b1ae8b7ff79268e9 Author: Thomas Groh Date: 2017-02-17T03:14:23Z Add a Base OverrideFactory class for 1-to-1 overrides These overrides are relatively common, and this reduces the reimplementation of mapping singletons and casting them. commit 2577f0b491b284a1a7c65b562b80614ff888050e Author: Thomas Groh Date: 2017-02-21T17:55:47Z Migrate DirectRunner one-to-one factories Use SingleInputOutputOverrideFactory to reduce prevalence of boilerplate. ---- > Get runners out of the apply() > ------------------------------ > > Key: BEAM-646 > URL: https://issues.apache.org/jira/browse/BEAM-646 > Project: Beam > Issue Type: Improvement > Components: beam-model-runner-api, sdk-java-core > Reporter: Kenneth Knowles > Assignee: Thomas Groh > Labels: backwards-incompatible > > Right now, the runner intercepts calls to apply() and replaces transforms as we go. This means that there is no "original" user graph. For portability and misc architectural benefits, we would like to build the original graph first, and have the runner override later. > Some runners already work in this manner, but we could integrate it more smoothly, with more validation, via some handy APIs on e.g. the Pipeline object. -- This message was sent by Atlassian JIRA (v6.3.15#6346)