beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaoran Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner
Date Wed, 03 May 2017 22:41:04 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995822#comment-15995822
] 

Chaoran Yu commented on BEAM-1920:
----------------------------------

The current Spark 1.6.3 runner is compiled with Scala 2.10. As 2.11 is more widely used now,
are we going to use 2.11 versions of Spark components?

> Add Spark 2.x support in Spark runner
> -------------------------------------
>
>                 Key: BEAM-1920
>                 URL: https://issues.apache.org/jira/browse/BEAM-1920
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-spark
>            Reporter: Jean-Baptiste Onofré
>            Assignee: Jean-Baptiste Onofré
>
> I have a branch working with both Spark 1 and Spark 2 backend.
> I'm preparing a pull request about that.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message