beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From amitsela <...@git.apache.org>
Subject [GitHub] incubator-beam pull request #585: Merge master into runners-spark2 branch to...
Date Sun, 03 Jul 2016 16:20:37 GMT
GitHub user amitsela opened a pull request:

    https://github.com/apache/incubator-beam/pull/585

    Merge master into runners-spark2 branch to keep up-to-date

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/amitsela/incubator-beam merge-master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/585.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #585
    
----
commit 4254749bf103c4bb6f68e316768c0aa46d9f7df0
Author: Kenneth Knowles <klk@google.com>
Date:   2016-05-05T22:11:07Z

    Configure RunnableOnService tests for Spark runner, batch mode

commit c4684bffc39ca3c40d2ef333502e0dd08d310591
Author: Pei He <peihe@google.com>
Date:   2016-06-16T18:38:51Z

    Remove the beam.examples dependency from flink.

commit da324bf522bdef7b990f79cd30fa6566029a748f
Author: Davor Bonaci <davor@google.com>
Date:   2016-06-17T18:40:54Z

    This closes #478

commit c666d4eedf9b0b85a24445bbe8bc69a0f26686f5
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T17:25:44Z

    Remove last vestige of the words DirectPipeline

commit 336ae2e7e3aba43e16a32f0b6b4dabbf92e8ff02
Author: Davor Bonaci <davor@google.com>
Date:   2016-06-17T18:45:49Z

    This closes #484

commit cdfab9ba95c3d0b32a8a46aa24b4895a9d261904
Author: Pei He <peihe@google.com>
Date:   2016-06-17T20:02:58Z

    Remove references to javax.servlet.

commit 47dd61a553a0440125eb2994a514904d739677cd
Author: Davor Bonaci <davor@google.com>
Date:   2016-06-17T20:53:59Z

    This closes #486

commit 6ebc8abe83b2417df9abe11c691a4f6cec4e66b6
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T20:22:26Z

    Finish removing DirectPipelineRunner references

commit 81dcd527888be7bcfde09e47a3f512aeafd4a962
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-17T22:11:01Z

    Closes #490

commit 3841f41133219272e1e88d6ba56b0d158d6bd59d
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T18:42:19Z

    Rename DataflowPipelineRunner to DataflowRunner

commit 8a9dcc71f08aa72a008344b75c30949703e7f6f5
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-17T22:13:39Z

    Closes #487

commit 95308fbbfa3accc5a1be5c87db729bcc41255156
Author: Pei He <peihe@google.com>
Date:   2016-06-16T22:50:21Z

    Turn on failOnWarning and ignore unused runners modules in example.

commit 69a4141a5a0176fdcada1917ba752e278a7f9e11
Author: Davor Bonaci <davor@google.com>
Date:   2016-06-17T22:26:52Z

    This closes #482

commit 916bf3a84776c45f679bc27dfbaa6e7eec205ef7
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T23:06:37Z

    Run Pipelines in tests that expect them

commit 93ca508bbdf558772e909df099148a9d03a1e6d4
Author: Aljoscha Krettek <aljoscha.krettek@gmail.com>
Date:   2016-06-01T09:56:18Z

    [BEAM-321] Fix Flink Comparators
    
    KvCoderComparator and CoderComparator were hashing the key directly
    while doing comparisons on the encoded form. This lead to
    inconsistencies in GroupByKey results with large numbers of elements per
    key.
    
    This changes the comparators to hash on the encoded form and also adds
    tests to verify the correct behavior.

commit 0e4d0a9ae0250863d7144ffdcc6c4e9cc099611f
Author: Aljoscha Krettek <aljoscha.krettek@gmail.com>
Date:   2016-06-19T09:35:19Z

    This closes #409

commit 380c1a83a82aa8b151d309cba82df3e2fb9398ec
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T23:36:22Z

    Remove Pipeline from TestDataflowPipelineRunner

commit d9cdcadf5b4b3aa931e14a3889a05cab69d71e09
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-20T16:27:49Z

    Closes #493

commit 1a200a65de1c48bb63b5bfa3e320e29f243fa902
Author: Kenneth Knowles <klk@google.com>
Date:   2016-06-20T17:03:51Z

    This closes #294

commit e471ced41d3092a7af6b9f5ad4cb5a4cd9dc2e81
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-16T15:57:18Z

    DataflowPipelineJob: Retry messages, metrics, and status polls
    
    At some point in the past, we decided to use a rawDataflowClient that
    does not do retries when checking job status, because it was best-effort
    reporting to users. The purported goal was to not clutter the log with
    networking errors.
    
    However, since that time, we have:
    * Added the ability to suppress logs (emit only at DEBUG level or not at
      all) when retrying.
    * Increased reliability of the job checking status so that these errors
      are less frequent and more indicative of quota or other issues.
    * Started using the metrics in tests, where we do need to retry
      transient issues (BEAM-350).
    
    So let's drop the raw transport client and just use the one that
    retries.

commit c71502dc94c71b527480db72d3410ffdae2e94d1
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-20T17:25:58Z

    Closes #476

commit c8d57429cb0b39ce4e9c6ff249fa12a5982a769a
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T16:57:25Z

    Rename FlinkPipelineRunner to FlinkRunner

commit 6f52ff940718c93508bf57e3e56f335ec6ae41b9
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-20T17:49:35Z

    Closes #489

commit 071d9c7ee8ed3a9628924de624d4e3cb03c5f20b
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-20T16:40:31Z

    Make JAXBCoder Thread Safe
    
    JAXB Marshaller and Unmarshaller are not thread safe, but coders are
    required to be.
    
    Create context only once, and create Marshaller and Unmarshaller locally
    on-demand.

commit 682a19c4e67512a912fd12c591d1ff0b73252984
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-20T18:26:32Z

    Closes #497

commit 278a76e096ced0ba51b5ed0ae8205bbd32491c77
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-20T22:44:54Z

    [BEAM-363] Return false for non-AUTO compression mode

commit 2b9906e8d97c254706656ac68eec85f29f946627
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-06-20T23:21:45Z

    Closes #504

commit b52688f4e41e0130ac5947e7771ad8606aa9913c
Author: Kenneth Knowles <klk@google.com>
Date:   2016-06-20T22:05:59Z

    Set runtime scope for Dataflow runner dep on runners-core

commit 2d563795b9ec3ec70f53980afa5bb2a50fd24518
Author: Kenneth Knowles <klk@google.com>
Date:   2016-06-21T17:21:34Z

    Remove temporary GroupAlsoByWindowViaWindowSetDoFn shim

commit 96ffc42972010c9b027e826d6d610555ab0c055a
Author: Thomas Groh <tgroh@google.com>
Date:   2016-06-17T17:45:09Z

    Rename SparkPipelineRunner to SparkRunner

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message