hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3528) Avro SerDe doesn't handle serializing Nullable types that require access to a Schema
Date Sat, 26 Jan 2013 14:39:13 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13563504#comment-13563504
] 

Hudson commented on HIVE-3528:
------------------------------

Integrated in Hive-trunk-hadoop2 #88 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/88/])
    HIVE-3528 : Avro SerDe doesn't handle serializing Nullable types that require access to
a Schema (Sean Busbey via Ashutosh Chauhan) (Revision 1438599)

     Result = FAILURE
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1438599
Files : 
* /hive/trunk/ql/src/test/queries/clientpositive/avro_nullable_fields.q
* /hive/trunk/ql/src/test/results/clientpositive/avro_nullable_fields.q.out
* /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerializer.java
* /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/avro/TestAvroDeserializer.java
* /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/avro/TestAvroObjectInspectorGenerator.java
* /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/avro/TestAvroSerializer.java

                
> Avro SerDe doesn't handle serializing Nullable types that require access to a Schema
> ------------------------------------------------------------------------------------
>
>                 Key: HIVE-3528
>                 URL: https://issues.apache.org/jira/browse/HIVE-3528
>             Project: Hive
>          Issue Type: Bug
>          Components: Serializers/Deserializers
>            Reporter: Sean Busbey
>            Assignee: Sean Busbey
>              Labels: avro
>             Fix For: 0.11.0
>
>         Attachments: HIVE-3528.1.patch.txt, HIVE-3528.2.patch.txt
>
>
> Deserialization properly handles hiding Nullable Avro types, including complex types
like record, map, array, etc. However, when Serialization attempts to write out these types
it erroneously makes use of the UNION schema that contains NULL and the other type.
> This results in Schema mis-match errors for Record, Array, Enum, Fixed, and Bytes.
> Here's a [review board of unit tests that express the problem|https://reviews.apache.org/r/7431/],
as well as one that supports the case that it's only when the schema is needed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message