Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B7B98D2E9 for ; Thu, 14 Feb 2013 18:07:13 +0000 (UTC) Received: (qmail 988 invoked by uid 500); 14 Feb 2013 18:07:13 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 886 invoked by uid 500); 14 Feb 2013 18:07:13 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 878 invoked by uid 500); 14 Feb 2013 18:07:13 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 871 invoked by uid 99); 14 Feb 2013 18:07:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Feb 2013 18:07:13 +0000 Date: Thu, 14 Feb 2013 18:07:12 +0000 (UTC) From: "Sean Busbey (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-3528) Avro SerDe doesn't handle serializing Nullable types that require access to a Schema MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13578534#comment-13578534 ] Sean Busbey commented on HIVE-3528: ----------------------------------- Hi Michael, Do you mean [Haivvreo|https://github.com/jghoman/haivvreo]? I don't believe this fix has been backported. Issues with that project should be filed [against its issue tracker|https://github.com/jghoman/haivvreo/issues]. I believe that project is only maintained on a best effort basis now, in favor of the integrated support within Hive. > Avro SerDe doesn't handle serializing Nullable types that require access to a Schema > ------------------------------------------------------------------------------------ > > Key: HIVE-3528 > URL: https://issues.apache.org/jira/browse/HIVE-3528 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers > Reporter: Sean Busbey > Assignee: Sean Busbey > Labels: avro > Fix For: 0.11.0 > > Attachments: HIVE-3528.1.patch.txt, HIVE-3528.2.patch.txt > > > Deserialization properly handles hiding Nullable Avro types, including complex types like record, map, array, etc. However, when Serialization attempts to write out these types it erroneously makes use of the UNION schema that contains NULL and the other type. > This results in Schema mis-match errors for Record, Array, Enum, Fixed, and Bytes. > Here's a [review board of unit tests that express the problem|https://reviews.apache.org/r/7431/], as well as one that supports the case that it's only when the schema is needed. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira