beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2371) Make Java DirectRunner demonstrate language-agnostic Runner API translation wrappers
Date Thu, 08 Jun 2017 22:00:20 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043517#comment-16043517
] 

ASF GitHub Bot commented on BEAM-2371:
--------------------------------------

GitHub user kennknowles reopened a pull request:

    https://github.com/apache/beam/pull/3330

    [BEAM-2371] Port DirectRunner overrides to SDK-agnostic APIs

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [x] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [x] Make sure tests pass via `mvn clean verify`.
     - [x] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [x] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
    
    ---
    
    R: @tgroh 
    
    This is peeled off my branch on the DirectRunner, which is now on switching up the evaluator
factories to support dehydrated/rehydrated pipelines. That thread is blocked on getting all
the inputs recorded but this little bit can go in sooner to avoid a mega PR.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kennknowles/beam DirectRunner-overrides

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3330.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3330
    
----
commit 9f380c61065632c959d135a0f3c6a6ae977c699e
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-26T21:26:55Z

    Port ViewOverrideFactory to SDK-agnostic APIs

commit 3cb6237085065cf7e9bd9dcf92953e409d422cd5
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-26T21:27:23Z

    Port DirectGroupByKey to SDK-agnostic APIs

commit d88b058aba3f7e5ca8a92f5e9fc61aa5b252f3f5
Author: Kenneth Knowles <klk@google.com>
Date:   2017-05-26T23:07:45Z

    Port DirectRunner WriteFiles override to SDK-agnostic APIs

commit 22b06906159b1e74ee68b9a57073126129264885
Author: Kenneth Knowles <klk@google.com>
Date:   2017-06-08T20:39:32Z

    Port DirectRunner TestStream override to SDK-agnostic APIs

commit 8b4630d4a97638e902dc5db8bcd79f65b366e558
Author: Kenneth Knowles <klk@google.com>
Date:   2017-06-08T20:46:18Z

    Add more utilities to ParDoTranslation

commit e141e4a48f321a04e2f4dd404ff650826da2f07c
Author: Kenneth Knowles <klk@google.com>
Date:   2017-06-08T21:27:02Z

    Enable SplittableParDo on rehydrated ParDo transform

commit ce657ab34c6f9b11e453d58981fb4183a1358b5f
Author: Kenneth Knowles <klk@google.com>
Date:   2017-06-08T20:44:52Z

    Port DirectRunner ParDo overrides to SDK-agnostic APIs

----


> Make Java DirectRunner demonstrate language-agnostic Runner API translation wrappers
> ------------------------------------------------------------------------------------
>
>                 Key: BEAM-2371
>                 URL: https://issues.apache.org/jira/browse/BEAM-2371
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-direct
>            Reporter: Kenneth Knowles
>            Assignee: Kenneth Knowles
>
> This will complete the PoC for runners-core-construction-java and the Runner API and
show other runners the easy path to executing non-Java pipelines, modulo Fn API.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message