beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-79) Gearpump runner
Date Fri, 07 Jul 2017 08:44:00 GMT


ASF GitHub Bot commented on BEAM-79:

GitHub user manuzhang opened a pull request:

    [BEAM-79] Sync gearpump-runner with master and upgrade to gearpump 0.8.4

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`.
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull sync-master

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3515
commit 7b8cd6401cb5ed6e184ed36571a89d3ae324dd5f
Author: Jeremie Lenfant-Engelmann <>
Date:   2017-06-29T01:32:56Z

    Properly convert milliseconds whether there's less than 3/more than 9 digits.
    TimeUtil did not properly convert (and returned null) when the number of
    digits for fractions of seconds was less than 3 digits or more than 9 digits.
    The solution is to pad with zeros when there is less than 3 digits and to
    truncate when there is more than 3.

commit f75dfe711b357800762a93dc5059d9a19da9ee61
Author: Luke Cwik <>
Date:   2017-06-30T16:00:13Z

    Properly convert milliseconds whether there's less than 3/more than 9 digits.
    This closes #3469

commit 56cb6c51748fde6ad56522733ab10edca062e802
Author: Kenneth Knowles <>
Date:   2017-06-13T17:29:50Z

    Add support for PipelineOptions parameters
    This is a step towards eliminating catch-all context parameters and
    making DoFns express their fine-grained data needs.

commit 0e429b33ff85eba08da5018c9febd0b99b44f720
Author: Kenneth Knowles <>
Date:   2017-06-30T22:39:20Z

    This closes #3355: Add support for PipelineOptions parameters

commit f99ab1a472868e4ce175a86e5d76823b1c09c10b
Author: Kenneth Knowles <>
Date:   2017-07-01T04:42:17Z

    Fix DoFn javadoc: StateSpec does not require a key

commit ce4e51747501111ae2c4b1691c6994bd0f92e161
Author: Ismaël Mejía <>
Date:   2017-06-04T20:55:05Z

    Make modules that depend on Hadoop and Spark use the same version property

commit 11010cf08ec9ca90a843cc15ea8f0fd4910f7fab
Author: Jean-Baptiste Onofré <>
Date:   2017-07-03T07:26:40Z

    This closes #3291

commit 75475ef3dc23a09fa9bbba478d6fdbc468f7dd2e
Author: Ismaël Mejía <>
Date:   2017-06-28T14:58:55Z

    [BEAM-2530] Fix compilation of modules with Java 9 that depend on

commit 0bd47c07659909c6b3c2d04fbdb96cc30a6e0243
Author: Jean-Baptiste Onofré <>
Date:   2017-07-03T12:23:18Z

    [BEAM-2530] This closes #3460

commit 68f1fb64fd2565e287e322d715ca778d01e7137b
Author: Ahmet Altay <>
Date:   2017-07-01T00:37:33Z

    For GCS operations use an http client with a default timeout value.

commit b8ac32641183b06a87517a169c8ecc5371996aed
Author: Ahmet Altay <>
Date:   2017-07-04T18:07:31Z

    This closes #3486

commit 51877a3405dbf778c3bb88f19bb194e54c3b3def
Author: Jean-Baptiste Onofré <>
Date:   2017-07-05T14:47:29Z

    [maven-release-plugin] prepare branch release-2.1.0

commit 7f0723cf7fd587c4f8dbe8a8b1c9d298a7b1e5e3
Author: Jean-Baptiste Onofré <>
Date:   2017-07-05T14:47:38Z

    [maven-release-plugin] prepare for next development iteration

commit 14fa7f79f0830739122b7573e032ad0aea172a98
Author: Jean-Baptiste Onofré <>
Date:   2017-07-05T14:52:48Z

    Update Python SDK version

commit 06897b1cc142f658437ac7779c849e5182e331f1
Author: Jason Kuster <>
Date:   2017-06-09T08:39:15Z

    Website Mergebot Job
    Signed-off-by: Jason Kuster <>

commit f0549b464737d0d11ae1da8e0534622b10247208
Author: Thomas Groh <>
Date:   2017-07-05T16:22:20Z

    This closes #3485

commit 6ca410a908f1f4e7ac1e141ee1335f7a537bb150
Author: Luke Cwik <>
Date:   2017-07-05T17:38:44Z

    [BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging improvements

commit 39c80f640749fed5f55a0c8f25c849e5f7c3d179
Author: Luke Cwik <>
Date:   2017-07-05T19:26:28Z

    [BEAM-2553] Update Maven exec plugin to 1.6.0 to incorporate messaging improvements
    This closes #3494

commit 29c2bca4649317f2ebb1c89f92bf97fbb27602ca
Author: Thomas Groh <>
Date:   2017-07-05T21:16:50Z

    Disallow Combiner Lifting for multi-window WindowFns

commit 63f66d6d81652dba5a7804648cde0e7debffd0f6
Author: Kenneth Knowles <>
Date:   2017-07-05T22:00:09Z

    This closes #3489: Fix DoFn javadoc: StateSpec does not require a key

commit 23e385faa193a00f9b10e3f8f0afe832087bff06
Author: Ahmet Altay <>
Date:   2017-07-05T21:34:07Z

    Update SDK dependencies

commit ea9f7fbdde5ede5e5f5060da5dfe2749992a2fa7
Author: Ahmet Altay <>
Date:   2017-07-05T23:11:46Z

    This closes #3497

commit e8fdd373c7b86652fda94ff76ef7246357e6288c
Author: Kenneth Knowles <>
Date:   2017-07-05T23:41:16Z

    This closes #3496: Disallow Combiner Lifting for multi-window WindowFns

commit a75202f344f22be5c5fdf62b3eb54a151ad29af6
Author: Charles Chen <>
Date:   2017-07-05T23:18:51Z

    Fix PValue input in _PubSubReadEvaluator

commit bf6dda32047e0bfba18de5aa27b1b6a593f86fc9
Author: Ahmet Altay <>
Date:   2017-07-06T01:09:05Z

    This closes #3499

commit 2259c309c5b81a5d1e32732dd35e1102766401fa
Author: Raghu Angadi <>
Date:   2017-06-28T19:07:06Z

    [BEAM-2534] Handle offset gaps in Kafka messages.
    KafkaIO logged a warning when there is a gap in offstes for messages.
    Kafka also support 'KV' store style topics where some of the messages
    are deleted leading gaps in offsets. This PR removes the log and
    accounts for offset gaps in backlog estimate.

commit 85a99e29448670ae6728a8ee2e4cd3ef95877c3e
Author: JingsongLi <>
Date:   2017-07-06T16:48:36Z

    This closes #3461

commit 526037b6786315b9f9fdca6edb636baeb6f83e3f
Author: Raghu Angadi <>
Date:   2017-07-04T06:54:10Z

    Add timeout to initialization of partition in KafkaIO

commit b8f8d18ae2cdbb4874d9a0f45038037ecc2381d1
Author: Kenneth Knowles <>
Date:   2017-07-06T18:59:18Z

    This closes #3492: [BEAM-2551] KafkaIO reader blocks indefinitely in case of network issues
      Add timeout to initialization of partition in KafkaIO

commit bd631b89a8434f0756e1596875e89013fb623ab5
Author: Kenneth Knowles <>
Date:   2017-06-23T01:09:11Z

    Ignore processing time timers in expired windows


> Gearpump runner
> ---------------
>                 Key: BEAM-79
>                 URL:
>             Project: Beam
>          Issue Type: New Feature
>          Components: runner-gearpump
>            Reporter: Tyler Akidau
>            Assignee: Manu Zhang
> Intel is submitting Gearpump ( to ASF (
Appears to be a mix of low-level primitives a la MillWheel, with some higher level primitives
like non-merging windowing mixed in. Seems like it would make a nice Beam runner.

This message was sent by Atlassian JIRA

View raw message