hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-7653) Hive AvroSerDe does not support circular references in Schema
Date Thu, 04 Sep 2014 19:37:52 GMT

    [ https://issues.apache.org/jira/browse/HIVE-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14121804#comment-14121804
] 

Hive QA commented on HIVE-7653:
-------------------------------



{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12666512/HIVE-7653.4.patch

{color:green}SUCCESS:{color} +1 6143 tests passed

Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/640/testReport
Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/640/console
Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-640/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12666512

> Hive AvroSerDe does not support circular references in Schema
> -------------------------------------------------------------
>
>                 Key: HIVE-7653
>                 URL: https://issues.apache.org/jira/browse/HIVE-7653
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.13.1
>            Reporter: Sachin Goyal
>            Assignee: Sachin Goyal
>         Attachments: HIVE-7653.1.patch, HIVE-7653.2.patch, HIVE-7653.3.patch, HIVE-7653.4.patch
>
>
> Avro allows nullable circular references but Hive AvroSerDe does not.
> Example of circular references (passing in Avro but failing in AvroSerDe):
> {code}
> class AvroCycleParent {
>   AvroCycleChild child;
>   public AvroCycleChild getChild () {return child;}
>   public void setChild (AvroCycleChild child) {this.child = child;}
> }
> class AvroCycleChild {
>   AvroCycleParent parent;
>   public AvroCycleParent getParent () {return parent;}
>   public void setParent (AvroCycleParent parent) {this.parent = parent;}
> }
> {code}
> Due to this discrepancy, Hive is unable to read Avro records having circular-references.
For some third-party code with such references, it becomes very hard to directly serialize
it with Avro and use in Hive.
> I have a patch for this with a unit-test and I will submit it shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message