hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szehon Ho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7653) Hive AvroSerDe does not support circular references in Schema
Date Tue, 10 Feb 2015 19:04:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314673#comment-14314673
] 

Szehon Ho commented on HIVE-7653:
---------------------------------

I almost forgot this one by now :)

Thanks,  pending tests on the new patch. +1

> Hive AvroSerDe does not support circular references in Schema
> -------------------------------------------------------------
>
>                 Key: HIVE-7653
>                 URL: https://issues.apache.org/jira/browse/HIVE-7653
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1
>            Reporter: Sachin Goyal
>            Assignee: Sachin Goyal
>         Attachments: HIVE-7653.1.patch, HIVE-7653.2.patch, HIVE-7653.3.patch, HIVE-7653.4.patch,
HIVE-7653.5.patch, HIVE-7653.6.patch
>
>
> Avro allows nullable circular references but Hive AvroSerDe does not.
> Example of circular references (passing in Avro but failing in AvroSerDe):
> {code}
> class AvroCycleParent {
>   AvroCycleChild child;
>   public AvroCycleChild getChild () {return child;}
>   public void setChild (AvroCycleChild child) {this.child = child;}
> }
> class AvroCycleChild {
>   AvroCycleParent parent;
>   public AvroCycleParent getParent () {return parent;}
>   public void setParent (AvroCycleParent parent) {this.parent = parent;}
> }
> {code}
> Due to this discrepancy, Hive is unable to read Avro records having circular-references.
For some third-party code with such references, it becomes very hard to directly serialize
it with Avro and use in Hive.
> I have a patch for this with a unit-test and I will submit it shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message