beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-25) Add user-ready API for interacting with state
Date Mon, 21 Nov 2016 20:03:58 GMT


ASF GitHub Bot commented on BEAM-25:

GitHub user kennknowles opened a pull request:

    [BEAM-25] Direct runner state

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [x] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [x] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [x] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull DirectRunner-state

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1399
commit 9d35e9f715f2c76ae54f3b304e41d1dbdf8c0f92
Author: Kenneth Knowles <>
Date:   2016-11-16T05:33:01Z

    Reject stateful DoFn in ApexRunner

commit aab81549a70d1ac3f6580f66759566f673c243b8
Author: Kenneth Knowles <>
Date:   2016-11-16T05:33:13Z

    Reject stateful DoFn in SparkRunner

commit 0c2aa666ecaf7def9fa28c6dc81b90c3ad0dc873
Author: Kenneth Knowles <>
Date:   2016-11-16T05:33:28Z

    Reject stateful DoFn in FlinkRunner

commit ec12dd3102d0a76e5b4cf7ad0a503b746e165d01
Author: Kenneth Knowles <>
Date:   2016-11-16T05:35:03Z

    Reject stateful DoFn in DataflowRunner

commit a66e71fb92734f6d423ce9ee012812322992ba40
Author: Kenneth Knowles <>
Date:   2016-11-10T05:10:51Z

    Add State parameter support to SimpleDoFnRunner

commit 8a058b14ab4084ee122d396f96ef2b76d86d3368
Author: Kenneth Knowles <>
Date:   2016-11-21T19:34:45Z

    Remove overspecified type in ParDoEvaluator

commit 677155a6148ea383065c1792db49e283e466cef1
Author: Kenneth Knowles <>
Date:   2016-11-10T05:59:15Z

    Add support for Stateful ParDo in the Direct runner
    This adds overrides and new evaluators to ensure that
    state is accessed in a single-threaded manner per key
    and is cleaned up when a window expires.


> Add user-ready API for interacting with state
> ---------------------------------------------
>                 Key: BEAM-25
>                 URL:
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-java-core
>            Reporter: Kenneth Knowles
>            Assignee: Kenneth Knowles
>              Labels: State
> Our current state API is targeted at runner implementers, not pipeline authors. As such
it has many capabilities that are not necessary nor desirable for simple use cases of stateful
ParDo (such as dynamic state tag creation). Implement a simple state intended for user access.
> (Details of our current thoughts in forthcoming design doc)

This message was sent by Atlassian JIRA

View raw message