hudi-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vinoyang (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HUDI-591) Support Spark version upgrade
Date Fri, 31 Jan 2020 14:29:00 GMT

    [ https://issues.apache.org/jira/browse/HUDI-591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17027539#comment-17027539
] 

vinoyang commented on HUDI-591:
-------------------------------

cc [~nishith29]

> Support Spark version upgrade
> -----------------------------
>
>                 Key: HUDI-591
>                 URL: https://issues.apache.org/jira/browse/HUDI-591
>             Project: Apache Hudi (incubating)
>          Issue Type: Sub-task
>          Components: Testing
>            Reporter: vinoyang
>            Assignee: vinoyang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Recently, the version of Spark that hudi depends on has been bumped from 2.2.x to 2.4.x.
However, this test suite born in the generation when hudi depends on Spark 2.2.x. After rebased
the test suite branch based on the master branch. There are some unit test cases failure.
The major reason is that the Avro dependency has been a bulit-in module in Spark. We need
to fix them.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message