beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-79) Gearpump runner
Date Thu, 04 May 2017 04:17:04 GMT


ASF GitHub Bot commented on BEAM-79:

GitHub user manuzhang opened a pull request:

    [BEAM-79] Merge master into gearpump-runner branch

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`.
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull sync-master

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2888
commit d9595d35176d2572423f6be069982b05eea204dd
Author: Maria Garcia Herrero <>
Date:   2017-04-26T23:22:09Z

    Add extra message to deprecated annotation

commit 42e3a6f8588046f257e5c780dec12d16d0314a66
Author: Ahmet Altay <>
Date:   2017-04-27T18:25:18Z

    This closes #2719

commit 9174ebf48391f393761b2ce085d2f165ebb2c7bb
Author: Tibor Kiss <>
Date:   2017-04-27T12:12:13Z

    [BEAM-1695] Improve Python-SDK's programming guide

commit 884935cb98f0e29bd965fda9182970423d111d7e
Author: Ahmet Altay <>
Date:   2017-04-27T19:03:22Z

    This closes #2738

commit e047b69efab9c988011303cf2eda86ac408b38c2
Author: Dan Halperin <>
Date:   2017-04-27T15:30:47Z

    [BEAM-2096] Make DataflowMetrics more resilient
    DataflowMetrics seems to have many hard-coded assumptions about what will be
    returned by the Dataflow service that, which will likely break when users
    use new types of metrics or if the Dataflow service makes minor adjustments
    in our it sends metrics back to the user.
    In order for code to continue working in these cases, handle errors by logging
    and skipping.

commit fdf2de9994268f5e1d704aa30a4504ac6ee624b8
Author: Dan Halperin <>
Date:   2017-04-27T20:10:32Z

    This closes #2739

commit f93a27755921e73141fd97de042e6dcd04e10a47
Author: Dan Halperin <>
Date:   2017-04-26T00:29:02Z

    [BEAM-59] Add FileSystems#matchNewResource
    The new FileSystems API needs a way to generate a ResourceId for a
    resource that does not exist. This does not come up in sources, because
    we typically are just matching existing files. However, sinks need the
    ability to reference a new directory (say, in order to create it).
    Couldn't think of anything better than a simple function that says
    "treat this string as a full resource path with the specified type",
    which is what FileSystems#matchNewResource is.

commit 14a90d7c5196d96de66e897687d28202d790439f
Author: Dan Halperin <>
Date:   2017-04-27T21:56:24Z

    This closes #2728

commit d3b399fa84bff45b0960368d32d4c69e433f4c94
Author: Thomas Groh <>
Date:   2017-04-26T22:12:54Z

    Remove Coder Encoding IDs
    These were never safe to use, and will not be used once Coders have been
    migrated to the Runner API representation.

commit c4936958834aa55f0f1fcb73fe9b8419c4c9eb9b
Author: Thomas Groh <>
Date:   2017-04-27T22:22:55Z

    This closes #2717

commit 1925a50d860b7b8f8422f1c2f251d0ea11def736
Author: Aviem Zur <>
Date:   2017-04-27T20:48:02Z

    [BEAM-2029] NullPointerException when using multi output ParDo in Spark runner in streaming

commit a46eb1a80074dc9c382da4d71725ffc61f2e65ba
Author: Dan Halperin <>
Date:   2017-04-27T22:33:39Z

    This closes #2746

commit 9a3b830c8737859c6afaa6e6e1922b037a78741f
Author: Dan Halperin <>
Date:   2017-04-27T22:35:10Z

    [BEAM-59] LocalResources: helper utility to create LocalResourceId
    Primarily for testing.

commit f71395bfd8f94cbe8d78098f5bb66a1dce65e74b
Author: Dan Halperin <>
Date:   2017-04-27T23:30:50Z

    This closes #2751

commit 95fdb8f4dbb6bb8ec6d80152aa85cc970ab13366
Author: Dan Halperin <>
Date:   2017-04-27T20:51:53Z

    WriteFiles: trivial message fix

commit 674ae9a475f1f236230697d5cb1c33d36fec49db
Author: Dan Halperin <>
Date:   2017-04-28T00:20:54Z

    This closes #2755

commit 06f4ef40bec7d6d3c5826fb9e0c164eb9c05efe7
Author: Ahmet Altay <>
Date:   2017-04-28T00:14:41Z

    Add a simple snippet for a composite transform.

commit 948f7ef2fc37b30809cf1adb2631eeb6a1e5eff3
Author: Ahmet Altay <>
Date:   2017-04-28T00:35:37Z

    This closes #2756

commit e1d5174eaffef3b2ac7df6187c43ffbccce32b09
Author: Luke Cwik <>
Date:   2017-04-27T23:24:57Z

    [BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler for auto registration
of Jackson modules
    This is towards adding a mixin module for Hadoop Configuration so that it can live on
a PipelineOptions object.

commit 185dc47982078124abf6e851ad1c66ebc4ae8c54
Author: Lukasz Cwik <>
Date:   2017-04-28T03:15:40Z

    [BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler for auto registration
of Jackson modules
    This closes #2752

commit 34c3ee7bfe0e0b6b95d0e9ec421a061116fc19b0
Author: Vikas Kedigehalli <>
Date:   2017-04-27T21:58:24Z

    [BEAM-59] Remove IOChannelFactory usage from NumberedShardedFile/ExplicitShardedFile

commit 47aaf11250e61d61c0bb3616063dbd5b7f2adb88
Author: Dan Halperin <>
Date:   2017-04-28T06:03:12Z

    This closes #2749

commit f37d954873ae03cdae854837570b62e334be9022
Author: Thomas Weise <>
Date:   2017-04-27T09:06:50Z

    BEAM-1981 Fix ApexTimerInternals serialization error.

commit 40a924d8d4e06ecbd7252ddbd6558415f899c123
Author: Luke Cwik <>
Date:   2017-04-27T18:34:01Z

    [BEAM-1871] Remove irrelevant runtime dependencies.
    Confirmed that sdks/java/io/gcp uses 1.22 for the removed libraries.

commit 849e39dfcf28a6edbf3f4c0469229778e0a52cb3
Author: Luke Cwik <>
Date:   2017-04-28T15:14:46Z

    [BEAM-1871] Remove irrelevant runtime dependencies
    This closes #2748

commit ce88c88b14e963ac17fac83dd19495c835c1f6cb
Author: Luke Cwik <>
Date:   2017-04-28T01:13:43Z

    [BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
    Note that I needed to update FileSystems to instantiate the FileSystem(s) upfront instead
of remembering the mapping from scheme to registrar.

commit ddabab3faded59e782455486fedf74b2ff60b60c
Author: Luke Cwik <>
Date:   2017-04-28T16:00:26Z

    [BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
    This closes #2757

commit fa422b9a81c303616786e8198d22c70df983d28e
Author: Ismaël Mejía <>
Date:   2017-04-28T15:25:30Z

    Remove missing references to the flink examples package after refactor

commit d08b72892bf900995667a37239e610bc2cd960d0
Author: Ismaël Mejía <>
Date:   2017-04-28T16:26:08Z

    This closes #2760

commit 594705d717dd6e5b81c08dcf4c56f8f6e7422737
Author: Peter Gergo Barna <>
Date:   2017-04-27T12:37:26Z

    [BEAM-2094] WordCount examples produce garbage for non-English input text


> Gearpump runner
> ---------------
>                 Key: BEAM-79
>                 URL:
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-gearpump
>            Reporter: Tyler Akidau
>            Assignee: Manu Zhang
> Intel is submitting Gearpump ( to ASF (
Appears to be a mix of low-level primitives a la MillWheel, with some higher level primitives
like non-merging windowing mixed in. Seems like it would make a nice Beam runner.

This message was sent by Atlassian JIRA

View raw message