hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-8271) Jackson incompatibility between hadoop-2.4 and hive-14
Date Fri, 03 Oct 2014 01:37:33 GMT

    [ https://issues.apache.org/jira/browse/HIVE-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157565#comment-14157565
] 

Brock Noland commented on HIVE-8271:
------------------------------------

[~gopalv] [~vikram.dixit]

This is causing TestHCatLoader to fail. I do not know why pre-commit did not find this. The
error:

{noformat}
java.io.IOException: Failed to execute "create table junit_unparted_basic(a int, b string)
stored as AVRO". Driver returned 1 Error: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask.
org.apache.avro.Schema$Field.<init>(Ljava/lang/String;Lorg/apache/avro/Schema;Ljava/lang/String;Lorg/codehaus/jackson/JsonNode;)V
	at org.apache.hive.hcatalog.pig.TestHCatLoader.executeStatementOnDriver(TestHCatLoader.java:163)
	at org.apache.hive.hcatalog.pig.TestHCatLoader.createTable(TestHCatLoader.java:148)
	at org.apache.hive.hcatalog.pig.TestHCatLoader.createTable(TestHCatLoader.java:137)
	at org.apache.hive.hcatalog.pig.TestHCatLoader.createTable(TestHCatLoader.java:152)
	at org.apache.hive.hcatalog.pig.TestHCatLoader.setup(TestHCatLoader.java:191)
{noformat}

I extracted the class and ran {{javap}} on the class. You can see that it has the relocated
name while HCatalog is compiled against the non-relocated version. Since Jackson is used publicly
by avro, I don't think we can relocate it.

{noformat}
$ javap org/apache/avro/Schema\$Field.class | grep org.apache.avro.Schema
Picked up _JAVA_OPTIONS: -Djava.awt.headless=true
public class org.apache.avro.Schema$Field extends org.apache.avro.JsonProperties {
  public org.apache.avro.Schema$Field(java.lang.String, org.apache.avro.Schema, java.lang.String,
org.apache.hive.org.codehaus.jackson.JsonNode);
  public org.apache.avro.Schema$Field(java.lang.String, org.apache.avro.Schema, java.lang.String,
org.apache.hive.org.codehaus.jackson.JsonNode, org.apache.avro.Schema$Field$Order);
{noformat}

> Jackson incompatibility between hadoop-2.4 and hive-14
> ------------------------------------------------------
>
>                 Key: HIVE-8271
>                 URL: https://issues.apache.org/jira/browse/HIVE-8271
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>    Affects Versions: 0.14.0
>            Reporter: Gopal V
>            Assignee: Gopal V
>            Priority: Blocker
>             Fix For: 0.14.0
>
>         Attachments: HIVE-8271.1.patch
>
>
> jackson-1.8 is not API compatible with jackson-1.9 (abstract classes).
> {code}
> threw an Error.  Shutting down now...
> java.lang.AbstractMethodError: org.codehaus.jackson.map.AnnotationIntrospector.findSerializer(Lorg/codehaus/jackson/map/introspect/Annotated;)Ljava/lang/Object;
> {code}
> hadoop-common (2.4) depends on jackson-1.8 and hive-14 depends on jackson-1.9.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message