Return-Path: Delivered-To: apmail-hadoop-common-commits-archive@www.apache.org Received: (qmail 97230 invoked from network); 30 Mar 2010 00:18:22 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 30 Mar 2010 00:18:22 -0000 Received: (qmail 94817 invoked by uid 500); 30 Mar 2010 00:18:22 -0000 Delivered-To: apmail-hadoop-common-commits-archive@hadoop.apache.org Received: (qmail 94787 invoked by uid 500); 30 Mar 2010 00:18:22 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 94780 invoked by uid 500); 30 Mar 2010 00:18:22 -0000 Delivered-To: apmail-hadoop-core-commits@hadoop.apache.org Received: (qmail 94777 invoked by uid 99); 30 Mar 2010 00:18:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Mar 2010 00:18:22 +0000 X-ASF-Spam-Status: No, hits=-1156.7 required=10.0 tests=ALL_TRUSTED,AWL X-Spam-Check-By: apache.org Received: from [140.211.11.130] (HELO eos.apache.org) (140.211.11.130) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 30 Mar 2010 00:18:21 +0000 Received: from eos.apache.org (localhost [127.0.0.1]) by eos.apache.org (Postfix) with ESMTP id 1ED171783C; Tue, 30 Mar 2010 00:18:01 +0000 (GMT) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable From: Apache Wiki To: Apache Wiki Date: Tue, 30 Mar 2010 00:18:00 -0000 Message-ID: <20100330001800.28798.65887@eos.apache.org> Subject: =?utf-8?q?=5BHadoop_Wiki=5D_Update_of_=22Hive/HBaseIntegration=22_by_John?= =?utf-8?q?Sichi?= Dear Wiki user, You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for ch= ange notification. The "Hive/HBaseIntegration" page has been changed by JohnSichi. http://wiki.apache.org/hadoop/Hive/HBaseIntegration?action=3Ddiff&rev1=3D20= &rev2=3D21 -------------------------------------------------- = The storage handler is built as an independent module, {{{hive_hbase_handler.jar}}}, which must be available on the Hive - client auxpath, along with HBase and Zookeeper jars. It requires + client auxpath, along with HBase and Zookeeper jars. It also requires - configuration property {{{hbase.master}}} in order to connect to the + the correct configuration property to be set in order to connect to the right HBase master. See [[http://hadoop.apache.org/hbase/docs/current/ap= i/overview-summary.html#overview_description|the HBase documentation]] for = how to set up an HBase cluster. = - Here's an example using CLI from a source build environment: + Here's an example using CLI from a source build environment, targeting a = single-node HBase server: = {{{ $HIVE_SRC/build/dist/bin/hive --auxpath $HIVE_SRC/build/hbase-handler/hiv= e_hbase-handler.jar,$HIVE_SRC/hbase-handler/lib/hbase-0.20.3.jar,$HIVE_SRC/= hbase-handler/lib/zookeeper-3.2.2.jar -hiveconf hbase.master=3Dhbase.yoyody= ne.com:60000 }}} = + Here's an example which instead targets a distributed HBase cluster where= a quorum of 3 zookeepers is used to elect the HBase master: + = + {{{ + $HIVE_SRC/build/dist/bin/hive --auxpath $HIVE_SRC/build/hbase-handler/hiv= e_hbase-handler.jar,$HIVE_SRC/hbase-handler/lib/hbase-0.20.3.jar,$HIVE_SRC/= hbase-handler/lib/zookeeper-3.2.2.jar -hiveconf hbase.zookeeper.quorum=3Dzk= 1.yoyodyne.com,zk2.yoyodyne.com,zk3.yoyodyne.com + }}} + = The handler requires Hadoop 0.20 or higher, and has only been tested - with dependency versions hadoop-0.20.0, hbase-0.20.3 and zookeeper-3.2.2. + with dependency versions hadoop-0.20.0, hbase-0.20.3 and zookeeper-3.2.2.= If you are not using hbase-0.20.3, you will need to rebuild the handler w= ith the HBase jar matching your version, and change the --auxpath above acc= ordingly. Failure to use matching versions will lead to misleading connect= ion failures such as HMasterNotRunningException since the HBase RPC protoco= l changes often. = In order to create a new HBase table which is to be managed by Hive, use the STORED BY clause on CREATE TABLE: