beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From k...@apache.org
Subject [12/12] beam git commit: This closes #3195: [BEAM-2333] Key DirectRunner translators off URN
Date Fri, 26 May 2017 04:08:18 GMT
This closes #3195: [BEAM-2333] Key DirectRunner translators off URN

  URNs for DirectRunner TransformEvaluator and RootInputProvider
  Add RawPTransform, which can just vend its URN and payload
  Add transform-analysis helpers to ReadTranslation
  Add trivial FlattenTranslator to access URN
  Register WindowIntoTranslator
  Register ReadTranslator
  Add registration for Read and WindowInto translators
  Allow getting URN for class of transform via translator
  Add URN for Splittable ProcessElement pseudo-primitive
  Centralize primitive URNs in PTransformTranslation class
  Make SdkComponents public for TransformPayloadTranslator


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9cd12907
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9cd12907
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9cd12907

Branch: refs/heads/master
Commit: 9cd12907ecbcf19b372185dff70a21e7e11fff6c
Parents: 50200f2 0e29cc5
Author: Kenneth Knowles <klk@google.com>
Authored: Thu May 25 20:52:13 2017 -0700
Committer: Kenneth Knowles <klk@google.com>
Committed: Thu May 25 20:52:13 2017 -0700

----------------------------------------------------------------------
 .../core/construction/FlattenTranslator.java    |  63 +++++++++
 .../construction/PCollectionTranslation.java    |   4 +-
 .../construction/PTransformTranslation.java     |  72 ++++++++++-
 .../core/construction/ParDoTranslation.java     |  14 +-
 .../core/construction/ReadTranslation.java      | 117 ++++++++++++++++-
 .../core/construction/SdkComponents.java        |   2 +-
 .../core/construction/SplittableParDo.java      |   3 +
 .../construction/WindowIntoTranslation.java     |  48 +++++++
 runners/direct-java/pom.xml                     |   5 +
 .../direct/BoundedReadEvaluatorFactory.java     |  14 +-
 .../beam/runners/direct/DirectGroupByKey.java   |  21 ++-
 .../beam/runners/direct/EmptyInputProvider.java |   8 +-
 .../direct/ParDoMultiOverrideFactory.java       |  13 +-
 .../runners/direct/ReadEvaluatorFactory.java    |  97 ++++++++++++++
 .../beam/runners/direct/RootInputProvider.java  |   7 +-
 .../runners/direct/RootProviderRegistry.java    |  28 ++--
 .../apache/beam/runners/direct/SourceShard.java |  33 +++++
 .../direct/TestStreamEvaluatorFactory.java      |  28 ++--
 .../direct/TransformEvaluatorRegistry.java      | 128 ++++++++++++++-----
 .../direct/UnboundedReadEvaluatorFactory.java   |  31 +++--
 .../runners/direct/ViewOverrideFactory.java     |  12 +-
 .../src/main/resources/beam/findbugs-filter.xml |   7 +
 22 files changed, 656 insertions(+), 99 deletions(-)
----------------------------------------------------------------------



Mime
View raw message