Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 41D2ADB99 for ; Thu, 26 Jul 2012 23:18:03 +0000 (UTC) Received: (qmail 69409 invoked by uid 500); 26 Jul 2012 23:18:02 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 69353 invoked by uid 500); 26 Jul 2012 23:18:02 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 69341 invoked by uid 99); 26 Jul 2012 23:18:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jul 2012 23:18:02 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sscaffidi@tripadvisor.com designates 199.102.233.253 as permitted sender) Received: from [199.102.233.253] (HELO zmb-mta2.tripadvisor.com) (199.102.233.253) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Jul 2012 23:17:53 +0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by zmb-mta2.tripadvisor.com (Postfix) with ESMTP id 4FFC010795C5 for ; Thu, 26 Jul 2012 19:14:56 -0400 (EDT) X-Virus-Scanned: amavisd-new at X-Spam-Score: -2.9 X-Spam-Level: Received: from zmb-mta2.tripadvisor.com ([127.0.0.1]) by localhost (zmb-mta2.tripadvisor.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8zAzaYFCocSm for ; Thu, 26 Jul 2012 19:14:56 -0400 (EDT) Received: from [192.168.1.100] (68-185-127-13.dhcp.oxfr.ma.charter.com [68.185.127.13]) (Authenticated sender: sscaffidi) by zmb-mta2.tripadvisor.com (Postfix) with ESMTPSA id 0F2351078EA8 for ; Thu, 26 Jul 2012 19:14:56 -0400 (EDT) From: Stephen Scaffid Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Custom SerDe and getting column comments Date: Thu, 26 Jul 2012 19:17:31 -0400 Message-Id: To: dev@hive.apache.org Mime-Version: 1.0 (Apple Message framework v1278) X-Mailer: Apple Mail (2.1278) X-Old-Spam-Flag: NO X-Old-Spam-Status: No, score=-2.9 tagged_above=-10 required=4.4 tests=[ALL_TRUSTED=-1, BAYES_00=-1.9] autolearn=ham I have a custom SerDe we are using and it works well. However, we have = one issue with it - an application used to allow users to maintain table = and column descriptions does not work with it. We store the descriptions as "comments" on the tables and columns, via a = python script that simply executes the necessary HQL to set the comment, = but then uses the Hive class to retrieve it from metadata. The problem is that any comment we try to set ends up getting set to = "from deserializer" on any table using our custom SerDe. This doesn't = happen with tables using the LazySimpleSerDe. Is there a way to make our SerDe work with comments?=