beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From peihe <>
Subject [GitHub] beam pull request #2672: Merge branch 'master' upto commit 686b774 into jsto...
Date Tue, 25 Apr 2017 10:22:35 GMT
GitHub user peihe opened a pull request:

    Merge branch 'master' upto commit 686b774 into jstorm-runner

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull jstorm-runner

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2672
commit 5b1d73fee3994784fd826aea1a7fc81c261d093f
Author: mdshalda <>
Date:   2017-04-06T05:23:00Z

    BEAM-1851: Update documentation for for fixedSizeGlobally to be clear about memory constraints.

commit e0df45850f8e7dc3d905afbca011c492a68b492f
Author: Davor Bonaci <>
Date:   2017-04-07T15:12:15Z

    This closes #2451

commit aac8b03289a296011a976b1edc0f66991e13013a
Author: Robert Bradshaw <>
Date:   2017-04-05T18:55:20Z

    Use absolute import for dataflow iobase test.

commit 661c06652da5d853904a74c5313ae978a29a60b7
Author: Ahmet Altay <>
Date:   2017-04-07T17:57:57Z

    This closes #2437

commit aaae9d776e958d6d891c2d2c635d0164f07132a1
Author: Sourabh Bajaj <>
Date:   2017-04-06T23:23:33Z

    [BEAM-778] Fix the Compressed file seek tests on windows

commit 0a8ac352834521eadb0ed30dec2ca28ff3b87785
Author: <>
Date:   2017-04-07T18:11:06Z

    This closes #2456

commit e05e60117f03fbcb1ba99fd5205b04cd37a917da
Author: Ahmet Altay <>
Date:   2017-04-07T18:21:17Z

    Clean up in textio and tfrecordio

commit 82c5e89ca07972f36e255a2dbb1258cabb6ec8fa
Author: Ahmet Altay <>
Date:   2017-04-07T18:47:03Z

    This closes #2461

commit ef344ee4b34abc19f27ec84a2b56f906009db23d
Author: Mark Liu <>
Date:   2017-04-07T21:30:44Z

    [BEAM-1823] Improve ValidatesRunner Test Log

commit 4fd8dc401b5cb995fea150204fd77a3f48150ee2
Author: Ahmet Altay <>
Date:   2017-04-07T22:02:46Z

    This closes #2464

commit 03a99b4df18ceeb7cd61953c461c4cca377a37ae
Author: Eugene Kirpichov <>
Date:   2017-04-07T19:09:47Z

    [BEAM-65] Adds HasDefaultTracker for RestrictionTracker inference
    Allows a restriction type to implement HasDefaultTracker,
    in that case the splittable DoFn itself does not need to
    implement NewTracker - only ProcessElement and GetInitialRestriction.

commit 8179d8c8af9f3afaa785755b13822d2bd508f789
Author: Eugene Kirpichov <>
Date:   2017-04-07T22:54:03Z

    Cleanup: removes two unused constants

commit 4a694cebb5deaf4f0d24bea18fa2194798a8ac0f
Author: Eugene Kirpichov <>
Date:   2017-04-07T22:55:43Z

    This closes #2462

commit dad7ace2b6143850fac0ca5359d9f56f5f0df2c1
Author: Eugene Kirpichov <>
Date:   2017-04-06T22:07:05Z

    Fixes SDF issues re: watermarks and stop/resume
    See detailed discussion in document:

commit 29c280211c2431f29c5552c35bd3435c65e4975b
Author: Eugene Kirpichov <>
Date:   2017-04-07T21:00:05Z

    Adds tests for the watermark hold (previously untested)

commit 19f407c9497c911ca3cb61d989aa5a78c84896cf
Author: Eugene Kirpichov <>
Date:   2017-04-08T00:00:39Z

    Clarifies doc of ProcessElement re: HasDefaultTracker

commit 1594849da972f5b4dcfc52eb3991d1df083d6719
Author: Eugene Kirpichov <>
Date:   2017-04-08T00:08:54Z

    This closes #2455

commit 8484ef9168940cf929648fd53982acc6740c5107
Author: Thomas Weise <>
Date:   2017-04-04T07:33:35Z

    BEAM-1887 Switch Apex ParDo to new DoFn.

commit 7f55746ce3eb2a0b6ee2f6372d6f7127835cbb34
Author: Eugene Kirpichov <>
Date:   2017-04-08T01:26:15Z

    This closes #2450

commit 042b28a681d1ee0c8942a0ec61df014c23a0fdaf
Author: Dan Halperin <>
Date:   2017-04-07T21:56:09Z

    TestDataflowRunner: better error handling
    1. There was a race in which pipelines without PAsserts might
       erroneously pass because they would be canceled, which would
       in turn cause the watermarks to reach max infinity, which
       would in turn (because there are no PAsserts) cause the main
       streaming poll loop think the pipeline succeeded.
       Fix this by making the error presence available to the main
       polling loop, and only canceling from there.
    2. The fact we were canceling from two places meant we could
       get double-cancelations that led to test failures.
    Fix both these issues (I hope).

commit 0c3dc0051a5e6ef4034df83b0d09467e7c55c1f0
Author: Dan Halperin <>
Date:   2017-04-08T01:48:52Z

    This closes #2465

commit 42f63342be667649eff5ea65dd9714c8b2f75cff
Author: rjoshi2 <>
Date:   2017-04-08T01:12:09Z

    Fix for potentially unclosed streams in ApexYarnLauncher

commit 810db7f990a9e39179f3613347ab5cde7e7c650c
Author: Thomas Weise <>
Date:   2017-04-08T04:56:11Z

    This closes #2469

commit 9e294dc05c1f1ac2aa2ac15f364394698a2767a7
Author: Amit Sela <>
Date:   2017-04-04T08:46:38Z

    [BEAM-1737] Implement a Single-output ParDo as a Multi-output ParDo with a single output.
    remove use of EvaluationContext in DStream lambda, it is not serializable and also redundant
in this
    implement pardo as multido.
    cache only if this is an actual MultiDo.

commit a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112
Author: Amit Sela <>
Date:   2017-04-09T07:06:08Z

    This closes #2420

commit d958796b525861764318f0c022e4987aa64ac300
Author: Aviem Zur <>
Date:   2017-02-17T10:35:49Z

    [BEAM-1294] Long running UnboundedSource Readers

commit efd785f881d2c231f202c5031d6aeeb042177850
Author: Aviem Zur <>
Date:   2017-04-09T19:47:03Z

    This closes #2033

commit 6da0b27aa56e8a133e206b5eb84b9ab937a2b17e
Author: mingmxu <>
Date:   2017-04-09T18:34:26Z

    [BEAM-1921] Expose connection properties in JdbcIO

commit 713701ddc43c3987e261ecd08b34131ea80c3999
Author: Jean-Baptiste Onofré <>
Date:   2017-04-09T20:16:17Z

    [BEAM-1921] This closes #2477

commit 6b2659cff9a7cc3283a8172ef87f589e887cf6f2
Author: Uwe Jugel <>
Date:   2017-04-10T12:24:44Z

    better log message for bigquery temp tables


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message