beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mariapython <...@git.apache.org>
Subject [GitHub] incubator-beam pull request #1416: Merge master
Date Tue, 22 Nov 2016 18:50:53 GMT
GitHub user mariapython opened a pull request:

    https://github.com/apache/incubator-beam/pull/1416

    Merge master

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mariapython/incubator-beam merge_master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/1416.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1416
    
----
commit 8390a2212e58b25c042b7324381a07e695e6551d
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-11-01T18:47:04Z

    Closes #1239

commit 4c0fab0b3a36d184c6d1fe060d60dd9b6678daf1
Author: Pei He <peihe@google.com>
Date:   2016-07-29T22:40:07Z

    Remove BlockingDataflowRunner

commit 1283308e2c99d1b0c2cf4640ad089f8a638d8163
Author: Davor Bonaci <davor@google.com>
Date:   2016-11-01T19:52:36Z

    This closes #762

commit bb66143754cc405435db734fb7629423b9ee292c
Author: Eugene Kirpichov <kirpichov@google.com>
Date:   2016-10-26T23:14:51Z

    Makes PTransformOverrideFactory type-safe

commit f6ad58d60c400765237ef213d3c5236f7e5d2369
Author: Thomas Groh <tgroh@google.com>
Date:   2016-11-01T21:06:35Z

    This closes #1201

commit 699075e250973447a9cdce1eb9c52d3406788212
Author: Jeremie Lenfant-Engelmann <jeremiele@google.com>
Date:   2016-10-21T02:29:39Z

    Added a where method on TypeDescriptor to allow substituting a type
    parameter with a TypeDescriptor. In the process introduced a TypeParameter
    class which represents the parameter type.
    This is useful when having a type such as Set<T> to be able to specify
    what T is as part of the TypeDescriptor information.

commit a36f1fa89079686cb1ce25a3c0abd3dd4f328c92
Author: Kenneth Knowles <klk@google.com>
Date:   2016-11-01T22:21:10Z

    Add header

commit 7e0cfe5b9c2ac2d0aeaf833a5e3097ce25a40c03
Author: Kenneth Knowles <klk@google.com>
Date:   2016-11-01T22:22:04Z

    This closes #968

commit 726998ae68ee99eb10bf43ff8aae1a5f121728a4
Author: Eugene Kirpichov <kirpichov@google.com>
Date:   2016-10-26T23:34:47Z

    Deduplicates ParDo{Single,Multi}EvaluatorFactory
    
    This is in preparation for adding a third one for a future ParDo-like primitive
    transform to be introduced inside SplittableParDo.

commit facf096e5007eba1ad46b63e52104331e163d756
Author: Thomas Groh <tgroh@google.com>
Date:   2016-11-01T23:45:07Z

    This closes #1203

commit 8183ac825d506a56421f41adc2e25b544f1bb80f
Author: Neelesh Srinivas Salian <nsalian@cloudera.com>
Date:   2016-10-22T20:05:48Z

    BEAM-239: Refactored the project to replace RemoveDuplicates to Distinct

commit 8883877ae91fa42963181d419d8f3cbfea8b314b
Author: Jesse Anderson <jesse@smokinghand.com>
Date:   2016-11-02T01:25:27Z

    This closes #1164

commit be4c0256f9be0813692674ba931579a72f9cc15c
Author: Sam McVeety <sgmc@google.com>
Date:   2016-11-01T16:27:44Z

    Add templateRunner option to Dataflow runner

commit 2c0d0f476ba92bf3b18bcc96f3dac47da176575d
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-11-02T04:31:56Z

    Closes #1249

commit ff5409f15a9f741f437c489b7de763cfa3c68278
Author: Sela <ansela@paypal.com>
Date:   2016-10-24T18:52:03Z

    [BEAM-808] Increase "spark.port.maxRetries" to avoid BindException in ROS.

commit 529f266ae91167997a17a952ee98b1721bba47a8
Author: Sela <ansela@paypal.com>
Date:   2016-11-02T12:54:21Z

    This closes #1170

commit e77d881aecc3f5fdbc407a252f9924c1226bcb4a
Author: Eugene Kirpichov <kirpichov@google.com>
Date:   2016-10-28T17:40:17Z

    [BEAM-854] Removes ReifyTimestampsAndWindows
    
    It was used effectively in 2 places:
    - GatherAllPanes (used in PAssert):
      replaced with a similar custom DoFn.
    - A couple of GBK-related transforms:
      folded into GroupByKeyOnly.
    
    Also makes GBKO produce globally-windowed KWIs.

commit 522469330dff8a65ff2e3d9b411c00a42c031864
Author: Thomas Groh <tgroh@google.com>
Date:   2016-11-02T17:18:59Z

    This closes #1225

commit 2f6104c903395ac8444fcaab8830e7178ebfe050
Author: Kenneth Knowles <klk@google.com>
Date:   2016-11-02T18:56:43Z

    [BEAM-887] Remove false/crashing "backwards compatibility" from Sink

commit 4dec38cee290335eeac6ba131386dd7d27c8d85d
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-11-02T22:53:26Z

    Closes #1263

commit 8c2b99e960edf3d9d6d6eda188c17c5729308edc
Author: peihe <peihe@users.noreply.github.com>
Date:   2016-11-02T17:44:58Z

    Upgrade google-api-services-dataflow to v1b3-rev43-1.22.0

commit d75d8b2bb7370f7b0527da73937f079b5b8ee09c
Author: Davor Bonaci <davor@google.com>
Date:   2016-11-02T23:51:08Z

    This closes #1259

commit 51af7e592327ef711673a2b9828536051a6c3898
Author: Thomas Weise <thw@apache.org>
Date:   2016-11-03T04:16:24Z

    Closes #1227

commit f233d858810cacace21b05e525131f05b26e6380
Author: Sela <ansela@paypal.com>
Date:   2016-11-03T12:13:33Z

    Revert "[BEAM-808] Increase "spark.port.maxRetries" to avoid BindException in ROS."
    
    This reverts commit ff5409f15a9f741f437c489b7de763cfa3c68278.

commit 6a05cf4a94728eb5e73a96e260eb5ef0bdc5fc9b
Author: Sela <ansela@paypal.com>
Date:   2016-11-03T13:35:10Z

    This closes #1270

commit f605b02a72258aee20d607e54a443113bfb762ad
Author: Pei He <peihe@google.com>
Date:   2016-10-21T01:07:35Z

    [BEAM-790] Validate PipelineOptions Default annotation

commit bdd71c4bcb6d761c5a71b433e2a27379a10da45d
Author: Luke Cwik <lcwik@google.com>
Date:   2016-11-03T18:56:22Z

    [BEAM-790] Validate PipelineOptions Default annotation.
    
    This closes #1159

commit d6f3a02d07257ceb30f294fb845e1fed4100362b
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-10-25T03:08:20Z

    gcp-io: add ApiSurfaceTest
    
    Copied from SDK, but I manually recreated the whitelist.
    
    Surely there are refactoring improvements to be had so that we can more easily
    reuse ApiSurface across modules.

commit c6c41eac3dca8508ab7920a66f3298fd3fd3f942
Author: Dan Halperin <dhalperi@google.com>
Date:   2016-11-03T19:31:48Z

    Closes #1183

commit 8c1008c42615dd7704fc2df02b140af1c8332c72
Author: Eugene Kirpichov <kirpichov@google.com>
Date:   2016-10-04T22:23:27Z

    Makes FileBasedSink use a temporary directory
    
    When writing to /path/to/foo, temporary files would be
    written to /path/too/foo-temp-$uid (or something like that),
    i.e. as siblings of the final output. That could lead
    to issues like http://stackoverflow.com/q/39822859/278042
    
    Now, temporary files are written to a path like:
    /path/too/temp-beam-foo-$date/$uid.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message