hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben McCann (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HADOOP-12527) Upgrade Avro dependency to 1.7.7
Date Wed, 06 Jul 2016 21:39:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365160#comment-15365160

Ben McCann edited comment on HADOOP-12527 at 7/6/16 9:38 PM:

+1 (although I'd really like to see Avro upgraded to 1.8.x)

was (Author: chengas123):
+1 (although I'd really like to see Avro upgraded to 1.8.x)

There's a patch available for this: https://github.com/apache/hadoop/pull/39

> Upgrade Avro dependency to 1.7.7
> --------------------------------
>                 Key: HADOOP-12527
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12527
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 2.7.1
>            Reporter: Jonathan Kelly
> Hadoop has depended upon Avro 1.7.4 for a couple of years now (see HADOOP-9672), but
Apache Spark depends upon what is currently the latest version of Avro (1.7.7).
> This can cause issues if Spark is configured to include the full Hadoop classpath, as
the classpath would then contain both Avro 1.7.4 and 1.7.7, with the 1.7.4 classes possibly
winning depending on ordering. Here is an example of this issue: http://stackoverflow.com/questions/33159254/avro-error-on-aws-emr/33403111#33403111
> Would it be possible to upgrade Hadoop's Avro dependency to 1.7.7 now?

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message