hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-3528) Avro SerDe doesn't handle serializing Nullable types that require access to a Schema
Date Fri, 19 Oct 2012 14:34:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13480056#comment-13480056
] 

Sean Busbey commented on HIVE-3528:
-----------------------------------

FYI, I'm working on the .q test, just building off of the example [on the using the Avro Serde
page|https://cwiki.apache.org/confluence/display/Hive/AvroSerDe+-+working+with+Avro+from+Hive].
Ran into some difficulty, trying to work back from the test logs to figure out what I'm doing
wrong.
                
> Avro SerDe doesn't handle serializing Nullable types that require access to a Schema
> ------------------------------------------------------------------------------------
>
>                 Key: HIVE-3528
>                 URL: https://issues.apache.org/jira/browse/HIVE-3528
>             Project: Hive
>          Issue Type: Bug
>          Components: Serializers/Deserializers
>            Reporter: Sean Busbey
>              Labels: avro
>         Attachments: HIVE-3528.1.patch.txt
>
>
> Deserialization properly handles hiding Nullable Avro types, including complex types
like record, map, array, etc. However, when Serialization attempts to write out these types
it erroneously makes use of the UNION schema that contains NULL and the other type.
> This results in Schema mis-match errors for Record, Array, Enum, Fixed, and Bytes.
> Here's a [review board of unit tests that express the problem|https://reviews.apache.org/r/7431/],
as well as one that supports the case that it's only when the schema is needed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message