beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré (JIRA) <j...@apache.org>
Subject [jira] [Created] (BEAM-1051) Extend the TestSparkRunner with its own TransformTranslator containing test evaluators
Date Sun, 27 Nov 2016 12:36:58 GMT
Jean-Baptiste Onofré created BEAM-1051:
------------------------------------------

             Summary: Extend the TestSparkRunner with its own TransformTranslator containing
test evaluators
                 Key: BEAM-1051
                 URL: https://issues.apache.org/jira/browse/BEAM-1051
             Project: Beam
          Issue Type: Improvement
          Components: runner-spark
            Reporter: Jean-Baptiste Onofré
            Assignee: Jean-Baptiste Onofré


When we have to test low level features in the Spark runner, requiring access to the {{RDDs}}
or {{DStreams}}, we have to create a "fake" {{PTransform}} with a custom evaluators in the
core Spark runner.

In order to avoid to pollute the core runner, this should be done in {{TestSparkRunner}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message