hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sachin Goyal (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7653) Hive AvroSerDe does not support circular references in Schema
Date Tue, 02 Sep 2014 19:48:22 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118614#comment-14118614
] 

Sachin Goyal commented on HIVE-7653:
------------------------------------

Thank you [~swarnim],   I am trying a dummy patch (with no logical changes).
I will update the patch with a valid one once tests have run for this dummy patch.

Corresponding review request is https://reviews.apache.org/r/24609/

> Hive AvroSerDe does not support circular references in Schema
> -------------------------------------------------------------
>
>                 Key: HIVE-7653
>                 URL: https://issues.apache.org/jira/browse/HIVE-7653
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1
>            Reporter: Sachin Goyal
>            Assignee: Sachin Goyal
>         Attachments: HIVE-7653.1.patch, HIVE-7653.2.patch, HIVE-7653.3.patch, HIVE-7653.5.patch,
HIVE-7653.DUMMY.4.patch
>
>
> Avro allows nullable circular references but Hive AvroSerDe does not.
> Example of circular references (passing in Avro but failing in AvroSerDe):
> {code}
> class AvroCycleParent {
>   AvroCycleChild child;
>   public AvroCycleChild getChild () {return child;}
>   public void setChild (AvroCycleChild child) {this.child = child;}
> }
> class AvroCycleChild {
>   AvroCycleParent parent;
>   public AvroCycleParent getParent () {return parent;}
>   public void setParent (AvroCycleParent parent) {this.parent = parent;}
> }
> {code}
> Due to this discrepancy, Hive is unable to read Avro records having circular-references.
For some third-party code with such references, it becomes very hard to directly serialize
it with Avro and use in Hive.
> I have a patch for this with a unit-test and I will submit it shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message