beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From github-...@apache.org
Subject [beam] tag nightly-master updated (05699c3 -> e542d1f)
Date Wed, 14 Jul 2021 03:27:10 GMT
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.


*** WARNING: tag nightly-master was modified! ***

    from 05699c3  (commit)
      to e542d1f  (commit)
    from 05699c3  [BEAM-12590] Automatically upgrading Dataflow Python pipelines that use
cross-language transforms to Runner v2 (#15079)
     add f9b9ccc  Merge pull request #14869 from [BEAM-12357] improve WithKeys transform to
take args, kwargs
     add 410cad1  Generalize S3FileSystem to support multiple URI schemes.
     add 5e26d3b  Merge pull request #15036: [BEAM-12435] Generalize S3FileSystem to support
multiple URI schemes.
     add bc742c8  [BEAM-12597] Add AppendingTransformer for reference.conf in shade
     add b97fe93  Merge pull request #15159: [BEAM-12597] Add AppendingTransformer for reference.conf
in shade
     add b7201a9  [BEAM-11434]Make SpannerAccessor public (#13641)
     add 3f9e1f3  [BEAM-12604] Do not expose Zookeeper client port in Kafka k8s config
     add f22868c  Merge pull request #15164 from ihji/BEAM-12604
     add f233725  Update Beam Go row coder to more completely handle schema interfaces (#15154)
     add 9215aea  Fix broken package substitution in starter archetype
     add f93a930  Merge pull request #15080 from shabbyrobe/fix/starter-archetype-package
     add e542d1f  [BEAM-12556] Enable Go Build Tests in Samza Runner (#15167)

No new revisions were added by this update.

Summary of changes:
 .github/PULL_REQUEST_TEMPLATE.md                   |   6 +-
 .test-infra/jenkins/README.md                      |   1 +
 ...job_PostCommit_Go_ValidatesRunner_Samza.groovy} |  10 +-
 .../kafka-cluster/03-zookeeper/30service.yml       |   1 -
 .../kafka-cluster/05-kafka/configmap-config.yaml   |   6 +-
 CHANGES.md                                         |   1 +
 README.md                                          |   2 +-
 .../beam/runners/samza/SamzaJobServerDriver.java   |   5 +-
 sdks/go/pkg/beam/core/graph/coder/iterable.go      |  24 +-
 sdks/go/pkg/beam/core/graph/coder/iterable_test.go |   6 +-
 sdks/go/pkg/beam/core/graph/coder/map.go           |  64 ++-
 sdks/go/pkg/beam/core/graph/coder/map_test.go      |   4 +-
 sdks/go/pkg/beam/core/graph/coder/row_decoder.go   | 125 +++--
 sdks/go/pkg/beam/core/graph/coder/row_encoder.go   | 130 +++--
 sdks/go/pkg/beam/core/graph/coder/row_test.go      | 219 ++++++++
 .../runners/{flink/flink.go => samza/samza.go}     |  10 +-
 sdks/go/pkg/beam/x/beamx/run.go                    |   1 +
 sdks/go/test/build.gradle                          |  25 +-
 sdks/go/test/integration/integration.go            |   8 +
 .../test/integration/io/xlang/kafka/kafka_test.go  |   1 +
 .../test/integration/primitives/primitives_test.go |   1 +
 .../test/integration/synthetic/synthetic_test.go   |   1 +
 .../test/integration/wordcount/wordcount_test.go   |   1 +
 sdks/go/test/integration/xlang/xlang_test.go       |   1 +
 sdks/go/test/regression/lperror_test.go            |   1 +
 sdks/go/test/regression/pardo_test.go              |   1 +
 sdks/go/test/run_validatesrunner_tests.sh          |  14 +-
 ...ava => DefaultS3FileSystemSchemeRegistrar.java} |  13 +-
 .../apache/beam/sdk/io/aws/s3/S3FileSystem.java    |  63 +--
 .../sdk/io/aws/s3/S3FileSystemConfiguration.java   | 118 +++++
 .../beam/sdk/io/aws/s3/S3FileSystemRegistrar.java  |  24 +-
 .../io/aws/s3/S3FileSystemSchemeRegistrar.java}    |  22 +-
 .../io/aws/s3/S3ReadableSeekableByteChannel.java   |  11 +-
 .../apache/beam/sdk/io/aws/s3/S3ResourceId.java    |  60 ++-
 .../beam/sdk/io/aws/s3/S3WritableByteChannel.java  |  35 +-
 .../beam/sdk/io/aws/s3/S3FileSystemTest.java       | 573 +++++++++++++++++++--
 .../beam/sdk/io/aws/s3/S3ResourceIdTest.java       |  83 ++-
 .../org/apache/beam/sdk/io/aws/s3/S3TestUtils.java |  71 ++-
 .../sdk/io/aws/s3/S3WritableByteChannelTest.java   |  86 +++-
 .../beam/sdk/io/gcp/spanner/SpannerAccessor.java   |   4 +-
 .../apache/beam/sdk/io/gcp/GcpApiSurfaceTest.java  |  11 +
 .../src/main/resources/archetype-resources/pom.xml |   3 +
 .../src/main/resources/archetype-resources/pom.xml |   3 +
 .../src/main/java/StarterPipeline.java             |   4 +-
 sdks/python/apache_beam/pvalue.py                  |   1 +
 sdks/python/apache_beam/transforms/core.py         |  16 +-
 sdks/python/apache_beam/transforms/util.py         |  32 +-
 sdks/python/apache_beam/transforms/util_test.py    |  26 +
 48 files changed, 1603 insertions(+), 325 deletions(-)
 copy .test-infra/jenkins/{job_PostCommit_Go_ValidatesRunner_Spark.groovy => job_PostCommit_Go_ValidatesRunner_Samza.groovy}
(83%)
 copy sdks/go/pkg/beam/runners/{flink/flink.go => samza/samza.go} (84%)
 copy sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/{S3FileSystemRegistrar.java
=> DefaultS3FileSystemSchemeRegistrar.java} (77%)
 create mode 100644 sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/S3FileSystemConfiguration.java
 copy sdks/java/{core/src/main/java/org/apache/beam/sdk/io/FileSystemRegistrar.java =>
io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/S3FileSystemSchemeRegistrar.java}
(59%)

Mime
View raw message