beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jbono...@apache.org
Subject [beam] branch dsl-euphoria updated (eff3ffd -> e282336)
Date Mon, 04 Jun 2018 11:50:59 GMT
This is an automated email from the ASF dual-hosted git repository.

jbonofre pushed a change to branch dsl-euphoria
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from eff3ffd  Merge pull request #5366 from dmvk/BEAM-3902
     add 2a34cad  [BEAM-3900] Allow for Beam windowing to be set through Euphoria API.
     add ef228ff  [BEAM-3900] Missing licence header added.
     add 3838e7b  [BEAM-4294] Join translator empty shell added.
     add 7ceefea  [BEAM-4294] Crude Join operator translation implemented. Still work in progress.
     add 7331ddd  [BEAM-4294] Inner join translation implemented.
     add 8ccfba5  [BEAM-4294] Left, right and full joins implemeted.
     add 4edd3f4  [BEAM-4294] BeamOperatorsSuite now includes tests of Join operator. Application
of windowing in JoinTranslator fixed.
     add 0df6b55  [BEAM-4360] ReduceStateByKey tests adaptation to beam. - Work in progress.
     add a2a355a  [BEAM-4360] Most tests are passing. Some are still ignored mostly due to
yet unsupported features.
     add aa658aa  [BEAM-4294] [BEAM-4360] Join translation and ReduceByKey test suite where
moved to org.apache.beam.* package. Small imports fixes after rebase to seznam/beam eff3ffd5d224c6628606b355e3a5b6d8bc40150b.
     add fee7abe  [BEAM-4294] [BEAM-4360] Checkstyle warning fixes.
     add a67b9c8  [BEAM-4394] Pull request review fixes.
     add 77df99d  [BEAM-4294] [BEAM-4360] Pull request review fixes. OperatorTranslator extended
to allow more than one translator per operator.
     add 99061eb  [BEAM-4294] [BEAM-4360] Circular dependency fix.
     add 8fdd427  [BEAM-4294] [BEAM-4360] Missing licenses added.
     add 4826847  [BEAM-4294] [BEAM-4360] Fix of local executor module compile error.
     add 939a104  [BEAM-4294] [BEAM-4360] Rollback of BEAM-3256 add archetype testing to gradle
build PreCommits.
     new e282336  Merge pull request #5447 from seznam/dsl-euphoria

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../job_beam_PreCommit_Java_GradleBuild.groovy     |   2 -
 build.gradle                                       |   2 -
 .../extensions/euphoria/euphoria-beam/build.gradle |   2 -
 .../extensions/euphoria/beam/FlowTranslator.java   |  51 ++-
 .../extensions/euphoria/beam/JoinTranslator.java   | 142 +++++++++
 .../euphoria/beam/OperatorTranslator.java          |  12 +-
 .../euphoria/beam/ReduceByKeyTranslator.java       |  39 +--
 .../euphoria/beam/ReduceStateByKeyTranslator.java  |   2 +-
 .../euphoria/beam/common/InputToKvDoFn.java}       |  22 +-
 .../euphoria/beam/common}/package-info.java        |   4 +-
 .../extensions/euphoria/beam/join/FullJoinFn.java  |  71 +++++
 .../extensions/euphoria/beam/join/InnerJoinFn.java |  59 ++++
 .../sdk/extensions/euphoria/beam/join/JoinFn.java  |  69 ++++
 .../euphoria/beam/join/LeftOuterJoinFn.java        |  65 ++++
 .../euphoria/beam/join/RightOuterJoinFn.java       |  62 ++++
 .../euphoria/beam/join}/package-info.java          |   5 +-
 .../euphoria/beam/window/BeamWindowing.java        |  77 +++++
 .../euphoria/beam/window/UnsupportedWindow.java}   |  35 +-
 .../euphoria/beam/window/WindowingUtils.java       |  75 +++++
 .../sdk/extensions/euphoria/beam/JoinTest.java     | 216 +++++++++++++
 .../extensions/euphoria/beam/ReduceByKeyTest.java  |  36 ++-
 .../sdk/extensions/euphoria/beam/TestUtils.java}   |  16 +-
 .../euphoria/beam/testkit/BeamOperatorsTest.java   |  25 --
 .../executor/local/testkit/LocalOperatorTest.java  |   6 +-
 .../euphoria-operator-testkit/build.gradle         |   8 +-
 .../euphoria/operator/test/AllOperatorsSuite.java  |  44 ---
 .../euphoria/operator/test/JoinTest.java           | 175 +++++++---
 .../euphoria/operator/test/ReduceByKeyTest.java    | 353 ++++++++++++++++-----
 .../operator/test/suite/OperatorsTestSuite.java}   |  16 +-
 .../operator/test/suite}/package-info.java         |   4 +-
 .../operator/test}/BeamExecutorProvider.java       |   3 +-
 .../euphoria/operator/test/OperatorsTest.java}     |  10 +-
 sdks/java/maven-archetypes/examples/build.gradle   |  11 -
 sdks/java/maven-archetypes/starter/build.gradle    |  11 -
 34 files changed, 1417 insertions(+), 313 deletions(-)
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/JoinTranslator.java
 copy sdks/java/extensions/{sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/BeamSqlOutputToConsoleFn.java
=> euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/common/InputToKvDoFn.java}
(59%)
 copy {runners/apex/src/main/java/org/apache/beam/runners/apex/translation/operators =>
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/common}/package-info.java
(87%)
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/FullJoinFn.java
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/InnerJoinFn.java
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/JoinFn.java
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/LeftOuterJoinFn.java
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/RightOuterJoinFn.java
 copy {runners/apex/src/main/java/org/apache/beam/runners/apex/translation/operators =>
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join}/package-info.java
(82%)
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/window/BeamWindowing.java
 copy sdks/java/extensions/euphoria/{euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/IntWindow.java
=> euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/window/UnsupportedWindow.java}
(63%)
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/window/WindowingUtils.java
 create mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/JoinTest.java
 copy sdks/java/extensions/euphoria/euphoria-beam/src/{main/java/org/apache/beam/sdk/extensions/euphoria/beam/package-info.java
=> test/java/org/apache/beam/sdk/extensions/euphoria/beam/TestUtils.java} (64%)
 delete mode 100644 sdks/java/extensions/euphoria/euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/testkit/BeamOperatorsTest.java
 delete mode 100644 sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/AllOperatorsSuite.java
 rename sdks/java/extensions/euphoria/{euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/testkit/BeamOperatorsSuite.java
=> euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/suite/OperatorsTestSuite.java}
(78%)
 copy {runners/gearpump/src/main/java/org/apache/beam/runners/gearpump/translators/utils =>
sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/suite}/package-info.java
(89%)
 rename sdks/java/extensions/euphoria/{euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/testkit
=> euphoria-operator-testkit/src/test/java/org/apache/beam/sdk/extensions/euphoria/operator/test}/BeamExecutorProvider.java
(96%)
 copy sdks/java/extensions/euphoria/euphoria-operator-testkit/src/{main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/package-info.java
=> test/java/org/apache/beam/sdk/extensions/euphoria/operator/test/OperatorsTest.java}
(79%)

-- 
To stop receiving notification emails like this one, please contact
jbonofre@apache.org.

Mime
View raw message