hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Kelly (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12527) Upgrade Avro dependency to 1.7.7
Date Thu, 29 Oct 2015 19:25:28 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981102#comment-14981102

Jonathan Kelly commented on HADOOP-12527:

Yes, definitely, but I just have not yet taken the time to test it more thoroughly. I just
wanted to cut this JIRA as soon as possible in order to start the discussion.

> Upgrade Avro dependency to 1.7.7
> --------------------------------
>                 Key: HADOOP-12527
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12527
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 2.7.1
>            Reporter: Jonathan Kelly
> Hadoop has depended upon Avro 1.7.4 for a couple of years now (see HADOOP-9672), but
Apache Spark depends upon what is currently the latest version of Avro (1.7.7).
> This can cause issues if Spark is configured to include the full Hadoop classpath, as
the classpath would then contain both Avro 1.7.4 and 1.7.7, with the 1.7.4 classes possibly
winning depending on ordering. Here is an example of this issue: http://stackoverflow.com/questions/33159254/avro-error-on-aws-emr/33403111#33403111
> Would it be possible to upgrade Hadoop's Avro dependency to 1.7.7 now?

This message was sent by Atlassian JIRA

View raw message