beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From github-...@apache.org
Subject [beam] tag nightly-master updated (55f42a5 -> c5b6a9a)
Date Fri, 13 Aug 2021 03:23:51 GMT
This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.


*** WARNING: tag nightly-master was modified! ***

    from 55f42a5  (commit)
      to c5b6a9a  (commit)
    from 55f42a5  [GoSDK Infra] Limit simultaneous tests binaries to 3. (#15321)
     add a440401  [BEAM-6374] Emit PCollection metrics from GoSDK (#15289)
     add 7f6a1c6  [BEAM-11779] Remove appliance restriction.
     add 066b0fb  [BEAM-11779] Remove appliance restriction.
     add 7c284e3  Python Kata - Event Time Triggers
     add e866d77  Python Kata - Event Time Triggers - Added license to task-info.yaml
     add 2522867  Python Kata - Event Time Triggers - refactored the accumulation mode setting
     add f96bec3  Python Kata - Event Time Triggers - task description corrected to reflect
the sample data generated
     add ceade99  Python Kata - Event Time Triggers - added streaming options
     add ffe375a  Python Kata - Event Time Triggers - add license text in task-info.yaml
     add 77bace2  Python Kata - Early Triggers
     add 526d6b9  Python Kata - Event Time Triggers & Early Triggers - task.md - corrected
documentation link
     add 1ce39b7  Python Kata - Window Accumulation Mode
     add 5d7781c  Python Kata - Event Time Triggers - removed the external transform commented
code
     add 9f24c4f  Merge branch 'apache:master' into python-katas-update
     add cfc847d  Python Kata - added license to course-info.yaml
     add a14f7e8  Merge pull request #15258 from Python katas update (Timers, Triggers, etc).
     add faac725  Merge pull request #15165 from [BEAM-12593] Verify DataFrame API on pandas
1.3.0
     add 413ade2  Add retry_gcs_file_copy when 500 errros happen from server
     add 9332f9b  [BEAM-12567] Retry GCS failure #15303
     add 6fb4afe  Merge pull request #15265 from [BEAM-12545] Extend FileSink by create_metadata
     add 31f81bc  Loosen typing extensions requirement
     add dcf5e8e  Merge pull request #15233: Loosen typing extensions requirement
     add 2b96f43  [BEAM-12453]: Add interface to access I/O topic information for a Samza
Beam job and PipelineJsonRenderer to create the JSON Beam DAG (#14945)
     add bd9e4d3  [BEAM-10212] Guard state caching with experiment (#15319)
     add 9378cd9  [BEAM-12719] ZetaSQL docs: replace out of date table with link to source.
     add c5b6a9a  Merge pull request #15282 from ibzib/BEAM-12719

No new revisions were added by this update.

Summary of changes:
 .../Early Triggers/generate_event.py               |  58 ++++++
 .../Early Triggers/Early Triggers/task-info.yaml}  |  25 ++-
 .../Triggers/Early Triggers/Early Triggers/task.md |  59 ++++++
 .../Triggers/Early Triggers/Early Triggers/task.py |  51 +++++
 .../Early Triggers/Early Triggers/tests.py         |  82 ++++++++
 .../Triggers/Early Triggers/lesson-info.yaml       |   0
 .../Event Time Triggers/generate_event.py          |  57 ++++++
 .../Event Time Triggers/task-info.yaml}            |  25 ++-
 .../Event Time Triggers/task.md                    |  70 +++++++
 .../Event Time Triggers/task.py                    |  50 +++++
 .../Event Time Triggers/tests.py                   |  87 +++++++++
 .../Event Time Triggers/lesson-info.yaml}          |  13 +-
 .../Window Accumulation Mode/generate_event.py     |  58 ++++++
 .../Window Accumulation Mode/task-info.yaml}       |  25 ++-
 .../Window Accumulation Mode/task.md               |  64 +++++++
 .../Window Accumulation Mode/task.py               |  51 +++++
 .../Window Accumulation Mode/tests.py              |  82 ++++++++
 .../Window Accumulation Mode/lesson-info.yaml      |   0
 .../{kotlin => python}/Triggers/section-info.yaml  |   0
 learning/katas/python/course-info.yaml             |   3 +-
 .../fnexecution/control/RemoteExecutionTest.java   |  25 ++-
 runners/samza/build.gradle                         |   1 +
 .../org/apache/beam/runners/samza/SamzaRunner.java |  19 +-
 .../runners/samza/util/PipelineJsonRenderer.java   | 209 +++++++++++++++++++++
 .../samza/util/PipelineJsonRendererTest.java       | 105 +++++++++++
 runners/samza/src/test/resources/ExpectedDag.json  |  68 +++++++
 sdks/go/pkg/beam/core/metrics/store.go             |  22 +++
 sdks/go/pkg/beam/core/runtime/exec/datasink.go     |  15 +-
 sdks/go/pkg/beam/core/runtime/exec/datasource.go   |  79 +++++---
 .../pkg/beam/core/runtime/exec/datasource_test.go  |  39 ++--
 sdks/go/pkg/beam/core/runtime/exec/pcollection.go  | 158 ++++++++++++++++
 .../pkg/beam/core/runtime/exec/pcollection_test.go | 154 +++++++++++++++
 sdks/go/pkg/beam/core/runtime/exec/plan.go         |  75 ++++----
 sdks/go/pkg/beam/core/runtime/exec/translate.go    |  38 +++-
 sdks/go/pkg/beam/core/runtime/harness/harness.go   |  29 ++-
 .../go/pkg/beam/core/runtime/harness/monitoring.go |  78 +++++---
 sdks/go/pkg/beam/runners/dataflow/dataflow.go      |   2 -
 sdks/go/pkg/beam/runners/direct/direct.go          |   3 +-
 .../fn/harness/control/ProcessBundleHandler.java   |  22 ++-
 sdks/python/apache_beam/dataframe/frames.py        |  21 ++-
 sdks/python/apache_beam/dataframe/frames_test.py   |  46 ++++-
 .../apache_beam/dataframe/pandas_doctests_test.py  |  58 +++++-
 sdks/python/apache_beam/io/fileio.py               |  44 ++++-
 .../runners/dataflow/internal/apiclient.py         |   3 +-
 sdks/python/setup.py                               |   4 +-
 .../en/documentation/dsls/sql/zetasql/overview.md  |  31 +--
 46 files changed, 1941 insertions(+), 267 deletions(-)
 create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/generate_event.py
 copy learning/katas/python/{course-info.yaml => Triggers/Early Triggers/Early Triggers/task-info.yaml}
(69%)
 create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/task.md
 create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/task.py
 create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/tests.py
 copy learning/katas/{kotlin => python}/Triggers/Early Triggers/lesson-info.yaml (100%)
 create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/generate_event.py
 copy learning/katas/python/{course-info.yaml => Triggers/Event Time Triggers/Event Time
Triggers/task-info.yaml} (69%)
 create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/task.md
 create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/task.py
 create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/tests.py
 copy learning/katas/python/{course-info.yaml => Triggers/Event Time Triggers/lesson-info.yaml}
(70%)
 create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation
Mode/generate_event.py
 copy learning/katas/python/{course-info.yaml => Triggers/Window Accumulation Mode/Window
Accumulation Mode/task-info.yaml} (69%)
 create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation
Mode/task.md
 create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation
Mode/task.py
 create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation
Mode/tests.py
 copy learning/katas/{kotlin => python}/Triggers/Window Accumulation Mode/lesson-info.yaml
(100%)
 copy learning/katas/{kotlin => python}/Triggers/section-info.yaml (100%)
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/util/PipelineJsonRenderer.java
 create mode 100644 runners/samza/src/test/java/org/apache/beam/runners/samza/util/PipelineJsonRendererTest.java
 create mode 100644 runners/samza/src/test/resources/ExpectedDag.json
 create mode 100644 sdks/go/pkg/beam/core/runtime/exec/pcollection.go
 create mode 100644 sdks/go/pkg/beam/core/runtime/exec/pcollection_test.go

Mime
View raw message