Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2463F11EF8 for ; Thu, 17 Jul 2014 04:24:24 +0000 (UTC) Received: (qmail 80643 invoked by uid 500); 17 Jul 2014 04:24:22 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 80578 invoked by uid 500); 17 Jul 2014 04:24:22 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 80568 invoked by uid 99); 17 Jul 2014 04:24:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 04:24:22 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of andrew.mains@kontagent.com designates 209.85.192.171 as permitted sender) Received: from [209.85.192.171] (HELO mail-pd0-f171.google.com) (209.85.192.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 04:24:17 +0000 Received: by mail-pd0-f171.google.com with SMTP id z10so2394008pdj.30 for ; Wed, 16 Jul 2014 21:23:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kontagent.com; s=corp; h=from:message-id:date:user-agent:mime-version:to:subject:references :in-reply-to:content-type; bh=sxeHgYWROCdFhmNgqUkmtGMirT9IP4VjaN1duhk7TK0=; b=AJfngTNEI1U3NAEvsJLTdLc4EJ95Q7UAc3zO7SsEaonwqH3+2+l4VAoPkqsPiWjufr k/TcEPsKQrjKP6C0xu7nD9pSuha047LN71uqhXEib8ZxzEJ3gsFXFgQhru9Ftffj7QM0 KJ+Kugm5koo8hEc49jOnPCs6N6Ee3t63j9uPo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:message-id:date:user-agent:mime-version:to :subject:references:in-reply-to:content-type; bh=sxeHgYWROCdFhmNgqUkmtGMirT9IP4VjaN1duhk7TK0=; b=TnuiBG5UXWCu+h7P33k6ytZf9wXaH+iGcKx1XoBeS0Xmb8UO9tkO5dXTx+fdV+ekY0 Um0Mdt9f3wSQuRAU9SzzKvj81UiDCZqD+ITeNsL0HP5YMNgOBL1FmIwQh8G0R7pOogu+ 4UjBZjlVO44PenBuOm6lPxv5DIGCl+25ssHrr1BbI76baVyEU6XMkIiLlMLQh8Q/ZP9B t9x/DjvjPztPCs8by9CJJdAdfeboMn+Mm81cb6dq7UBDW3LBGH3mv1TQrG+fTkVtgpyT VnJjuqr/EiPBXClLda64culFZhZM7huRS1qu3MxZrJFFxcPCOwOc3Dbb5YpaWbxqihtT r4pg== X-Gm-Message-State: ALoCoQkq7lFtKFM1bllFAfGXd+IDubYjWt4uaU1cWCBG1LgvcKQeg0TQWaG7Kj58kuxgmNooyw2X X-Received: by 10.68.134.198 with SMTP id pm6mr34331876pbb.9.1405571036519; Wed, 16 Jul 2014 21:23:56 -0700 (PDT) Received: from andrewmmacbook2.att.net ([108.205.49.248]) by mx.google.com with ESMTPSA id pl10sm977096pbb.56.2014.07.16.21.23.53 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 16 Jul 2014 21:23:55 -0700 (PDT) From: Andrew Mains X-Google-Original-From: Andrew Mains Message-ID: <53C74FD7.4070102@upsight.com> Date: Wed, 16 Jul 2014 21:23:51 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 MIME-Version: 1.0 To: user@hive.apache.org Subject: Re: Custom HBaseKeyFactory and ColumnMapping References: <53C714E4.6010201@upsight.com> <53C71587.9080507@upsight.com> In-Reply-To: Content-Type: multipart/alternative; boundary="------------030909050201070008050808" X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. --------------030909050201070008050808 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Done. https://issues.apache.org/jira/browse/HIVE-7433 Andrew On 7/16/14, 6:09 PM, Navis류승우 wrote: > My bad. Could you do that? > > Thanks, > Navis > > > 2014-07-17 9:15 GMT+09:00 Andrew Mains >: > > Hi all, > > I'm currently experimenting with using the new HBaseKeyFactory > interface (implemented in > https://issues.apache.org/jira/browse/HIVE-6411) to do some custom > serialization and predicate pushdown on our HBase schema. Ideally, > I'd like to be able to use the information from the > hbase.columns.mapping property on the table, and indeed, > AbstractHBaseKeyFactory seems to support this use case, exposing a > protected ColumnMappings.ColumnMapping keyMapping member. However, > ColumnMappings.ColumnMapping exposes no public members (everything > is package private org.apache.hadoop.hive.hbase), meaning that I > can't read any data from the ColumnMapping in my custom > HBaseKeyFactory. > > Is this behavior intentional? Obviously I could work around this > by declaring my factory in the same package, but it seems like the > user experience would be better if there were public accessors for > the fields in ColumnMappings.ColumnMapping. Is there another way > to do this that I'm missing? If this isn't intentional, I'll raise > a JIRA issue and submit a (small) patch. > > Thanks! > > Andrew > > > > --------------030909050201070008050808 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
Done. https://issues.apache.org/jira/browse/HIVE-7433

Andrew

On 7/16/14, 6:09 PM, Navis류승우 wrote:
My bad. Could you do that?

Thanks,
Navis


2014-07-17 9:15 GMT+09:00 Andrew Mains <andrew.mains@kontagent.com>:
Hi all,

I'm currently experimenting with using the new HBaseKeyFactory interface (implemented in https://issues.apache.org/jira/browse/HIVE-6411) to do some custom serialization and predicate pushdown on our HBase schema. Ideally, I'd like to be able to use the information from the hbase.columns.mapping property on the table, and indeed, AbstractHBaseKeyFactory seems to support this use case, exposing a protected ColumnMappings.ColumnMapping keyMapping member. However, ColumnMappings.ColumnMapping exposes no public members (everything is package private org.apache.hadoop.hive.hbase), meaning that I can't read any data from the ColumnMapping in my custom HBaseKeyFactory.

Is this behavior intentional? Obviously I could work around this by declaring my factory in the same package, but it seems like the user experience would be better if there were public accessors for the fields in ColumnMappings.ColumnMapping. Is there another way to do this that I'm missing? If this isn't intentional, I'll raise a JIRA issue and submit a (small) patch.

Thanks!

Andrew





--------------030909050201070008050808--