pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rohini Palaniswamy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-4111) Make Pig compiles with avro-1.7.7
Date Wed, 11 May 2016 17:37:12 GMT

    [ https://issues.apache.org/jira/browse/PIG-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15280491#comment-15280491

Rohini Palaniswamy commented on PIG-4111:

Actually the change of 1 to -1 (6) is better as it gives better compression. Had noticed that
the compression is not that good a while back but had missed filing a jira. So it is good
that this patch fixes that.

bq. I haven't tried this but I think it is safe to say people should include the 'latest'
version of various libraries in their project. 
   Hadoop has older version of avro (1.7.4) and that will always take precedence unless user
sets mapreduce.user.classpath.first to true. So please just test once to ensure it does not
have any NoSuchFieldError because of the static import when running against older versions.
I am good with the current patch and will proceed to commit if the test is good.

trevni test jar is most likely not required and you can give a shot at excluding it if you
want to move to avro-1.7.8 - http://ant.apache.org/ivy/history/2.0.0/ivyfile/artifact-exclude.html

> Make Pig compiles with avro-1.7.7
> ---------------------------------
>                 Key: PIG-4111
>                 URL: https://issues.apache.org/jira/browse/PIG-4111
>             Project: Pig
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 0.13.0
>            Reporter: fang fang chen
>            Assignee: fang fang chen
>             Fix For: site
>         Attachments: PIG-4111-1.patch, PIG-4111.patch
> pig-0.13 compile failed with avro-1.7.7:
>     [javac] /root/ff/git/pig/src/org/apache/pig/impl/util/avro/AvroRecordWriter.java:23:
error: cannot find symbol
>     [javac] import static org.apache.avro.mapred.AvroOutputFormat.DEFAULT_DEFLATE_LEVEL;
>     [javac] ^
>     [javac]   symbol:   static DEFAULT_DEFLATE_LEVEL
>     [javac]   location: class
>     [javac]   where T is a type-variable:
>     [javac]     T extends Object declared in class AvroOutputFormat
>     [javac] /root/ff/git/pig/src/org/apache/pig/impl/util/avro/AvroRecordWriter.java:76:
error: cannot find symbol
>     [javac]           DEFAULT_DEFLATE_LEVEL);
>     [javac]           ^
>     [javac]   symbol:   variable DEFAULT_DEFLATE_LEVEL
>     [javac]   location: class AvroRecordWriter

This message was sent by Atlassian JIRA

View raw message