beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From aromane...@apache.org
Subject [beam] branch master updated (0e9ab8d -> 8db095d)
Date Mon, 15 Apr 2019 09:29:57 GMT
This is an automated email from the ASF dual-hosted git repository.

aromanenko pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 0e9ab8d  Merge pull request #8304: [BEAM-7075] Create Redis embedded server on @BeforeClass
and simplify tests
     new 3602c27  [BEAM-7076] Update Spark runner to use spark version 2.4.1
     new 6f3d85f  [BEAM-7076] Multiple static analysis fixes on Spark runner
     new 8db095d  Merge pull request #8305: [BEAM-7076] Update Spark runner to use spark version
2.4.1

The 20982 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |  2 +-
 .../runners/spark/SparkNativePipelineVisitor.java  |  5 ++--
 .../beam/runners/spark/SparkPipelineResult.java    |  6 ++---
 .../org/apache/beam/runners/spark/SparkRunner.java |  6 ++---
 .../runners/spark/SparkTransformOverrides.java     |  2 +-
 .../apache/beam/runners/spark/TestSparkRunner.java |  2 +-
 .../runners/spark/aggregators/AggAccumParam.java   |  2 +-
 .../spark/coders/StatelessJavaSerializer.java      |  2 +-
 .../beam/runners/spark/examples/WordCount.java     |  2 +-
 .../apache/beam/runners/spark/io/SourceRDD.java    |  2 +-
 .../runners/spark/io/SparkUnboundedSource.java     |  2 +-
 .../metrics/SparkMetricsContainerStepMap.java      |  2 +-
 .../SparkGroupAlsoByWindowViaWindowSet.java        |  2 +-
 .../spark/stateful/SparkStateInternals.java        |  2 +-
 .../runners/spark/stateful/StateSpecFunctions.java |  2 +-
 .../spark/translation/EvaluationContext.java       |  7 +++---
 .../spark/translation/MultiDoFnFunction.java       |  3 +--
 .../ReifyTimestampsAndWindowsFunction.java         |  2 +-
 .../spark/translation/SparkAbstractCombineFn.java  | 18 +++++++-------
 .../spark/translation/SparkAssignWindowFn.java     |  2 +-
 .../translation/SparkExecutableStageFunction.java  |  2 +-
 .../spark/translation/SparkGlobalCombineFn.java    |  3 +--
 .../SparkGroupAlsoByWindowViaOutputBufferFn.java   |  2 +-
 .../spark/translation/SparkKeyedCombineFn.java     |  1 -
 .../spark/translation/SparkPCollectionView.java    |  2 +-
 .../spark/translation/SparkProcessContext.java     |  2 +-
 .../spark/translation/TransformTranslator.java     |  3 ---
 .../spark/translation/streaming/Checkpoint.java    |  4 ++--
 .../streaming/StreamingTransformTranslator.java    |  2 --
 .../runners/spark/util/GlobalWatermarkHolder.java  |  4 +---
 .../runners/spark/util/SparkSideInputReader.java   | 28 ++++++++++------------
 .../beam/runners/spark/ClearWatermarksRule.java    |  2 +-
 .../runners/spark/ProvidedSparkContextTest.java    | 18 +++-----------
 .../beam/runners/spark/SparkPipelineStateTest.java |  2 +-
 .../ResumeFromCheckpointStreamingTest.java         |  5 ++--
 .../streaming/utils/EmbeddedKafkaCluster.java      |  9 +++----
 36 files changed, 66 insertions(+), 96 deletions(-)


Mime
View raw message