beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From chamikaramj <>
Subject [GitHub] beam pull request #3333: [BEAM-1630] Adds ability to dynamically replace PTr...
Date Thu, 08 Jun 2017 22:07:23 GMT
GitHub user chamikaramj opened a pull request:

    [BEAM-1630] Adds ability to dynamically replace PTransforms during runtime.

    Adds two new interfaces, PTransformMatcher and PTransformOverride.
    Currently only supports replacements where input and output types are an exact match (we
have to address complexities due to type hints before supporting replacements with different
    This can be used to dynamically update a populated pipeline at runtime. Each runner can
configure it's own overrides.
    This will be used by SplittableDoFn where matching ParDo transforms will be dynamically
replaced by SplittableParDo.

You can merge this pull request into a Git repository by running:

    $ git pull sdf_direct_runner_ptransform_override

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3333


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message