crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom White (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CRUNCH-618) Run on Spark 2
Date Fri, 09 Sep 2016 10:23:21 GMT

     [ https://issues.apache.org/jira/browse/CRUNCH-618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tom White updated CRUNCH-618:
-----------------------------
    Attachment: CRUNCH-618.patch

Here's a patch which switches to Spark 2.0.0 and Scala 2.11 (used by Spark 2 now). Most of
this was written by [~irashid].

Due to SPARK-3369 the change from Spark 1 to Spark 2 is not backwards compatible (for Crunch),
which means we have to be careful when we introduce this change.

> Run on Spark 2
> --------------
>
>                 Key: CRUNCH-618
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-618
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Spark
>    Affects Versions: 0.14.0
>            Reporter: Tom White
>            Assignee: Tom White
>         Attachments: CRUNCH-618.patch
>
>
> Spark 2 is GA now so it would be good to be able to run Crunch on it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message