beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stas Levin (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (BEAM-1039) Spark context is never actually re-used in tests
Date Tue, 22 Nov 2016 21:15:58 GMT

     [ https://issues.apache.org/jira/browse/BEAM-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Stas Levin closed BEAM-1039.
----------------------------
       Resolution: Not A Problem
    Fix Version/s: Not applicable

> Spark context is never actually re-used in tests
> ------------------------------------------------
>
>                 Key: BEAM-1039
>                 URL: https://issues.apache.org/jira/browse/BEAM-1039
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-spark
>            Reporter: Stas Levin
>            Assignee: Stas Levin
>             Fix For: Not applicable
>
>
> I think that due to a slight typo {{Boolean.getBoolean(TEST_REUSE_SPARK_CONTEXT)}} got
mixed up with
> {{Boolean.getBoolean(System.getProperty(TEST_REUSE_SPARK_CONTEXT))}} in the following
2 places, which may have caused {{SparkContext}} to behave not quite as expected.
> *  https://github.com/apache/incubator-beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkContextFactory.java#L52
> *  https://github.com/apache/incubator-beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkContextFactory.java#L70
> I'll take care of it as part of something I'm working on, so a PR should follow shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message