Return-Path: Delivered-To: apmail-hive-user-archive@www.apache.org Received: (qmail 75160 invoked from network); 22 Mar 2011 17:59:28 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 22 Mar 2011 17:59:28 -0000 Received: (qmail 22911 invoked by uid 500); 22 Mar 2011 17:59:27 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 22870 invoked by uid 500); 22 Mar 2011 17:59:27 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 22862 invoked by uid 99); 22 Mar 2011 17:59:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Mar 2011 17:59:27 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.161.48 as permitted sender) Received: from [209.85.161.48] (HELO mail-fx0-f48.google.com) (209.85.161.48) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Mar 2011 17:59:21 +0000 Received: by fxm7 with SMTP id 7so9088666fxm.35 for ; Tue, 22 Mar 2011 10:59:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=9IY2OTeOg4qSxstylk6VHhnOq8sIxyiMWtfNCcbuVBk=; b=E/8ib2JCp5mh1nYnEFaay+STaVkxcU45mx+q6+nKYBVOP3LC+Iymm3fDryWewIbb1D bQ0xP1FkbEjaXTcWYHHhYjBBFfRqLHKsRTm9GQdE5ryWrWm62qwE34vP5+laBO3gFx// 5YpKzfY4xool7XXQaLrLQuFSpcJbnYX6yEpIw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=NQAsqJXtP+EwQa09OKsVQIZ0upKODimwN0yHYv4W1dbxu3P6aRYFGhrj3WoSFsQTEe MWR/q4yCBcwVSJYm0XiX3OJ2XiAgZqa/D7rL1FQvMOdHEMcaHMa8BR0uvHn9r4qz1K4Z vu6Nr6MJKiJo/fA55GP4eE0pOGHJB3iUGg6Cg= MIME-Version: 1.0 Received: by 10.223.143.5 with SMTP id s5mr685476fau.14.1300816726849; Tue, 22 Mar 2011 10:58:46 -0700 (PDT) Received: by 10.223.95.195 with HTTP; Tue, 22 Mar 2011 10:58:46 -0700 (PDT) In-Reply-To: References: Date: Tue, 22 Mar 2011 10:58:46 -0700 Message-ID: Subject: Re: Hive/hbase integration - Rebuild the Storage Handler From: Ted Yu To: user@hive.apache.org Cc: dev@hbase.apache.org Content-Type: multipart/alternative; boundary=0023545bdbc0ebfa66049f15fe50 X-Virus-Checked: Checked by ClamAV on apache.org --0023545bdbc0ebfa66049f15fe50 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Look at this line in ivy/libraries.properties: hbase.version=3D0.89.0-SNAPSHOT The jars would be downloaded to: ./build/ivy/lib/default/hbase-0.89.0-SNAPSHOT-tests.jar ./build/ivy/lib/default/hbase-0.89.0-SNAPSHOT.jar After changing hbase.version, I saw: [ivy:resolve] :: problems summary :: [ivy:resolve] :::: WARNINGS [ivy:resolve] module not found: org.apache.hbase#hbase;0.90.0-SNAPSHOT [ivy:resolve] =3D=3D=3D=3D hadoop-source: tried [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar: [ivy:resolve] http://mirror.facebook.net/facebook/hive-deps/hadoop/core/hbase-0.90.0-SNAP= SHOT/hbase-0.90.0-SNAPSHOT.jar [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar(test-jar): [ivy:resolve] http://mirror.facebook.net/facebook/hive-deps/hadoop/core/hbase-0.90.0-SNAP= SHOT/hbase-0.90.0-SNAPSHOT.jar [ivy:resolve] =3D=3D=3D=3D apache-snapshot: tried [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hba= se/hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.pom [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar: [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hba= se/hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.jar [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar(test-jar): [ivy:resolve] https://repository.apache.org/content/repositories/snapshots/org/apache/hba= se/hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT-tests.jar [ivy:resolve] =3D=3D=3D=3D maven2: tried [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.90.0-SNAPSHOT/hbase-= 0.90.0-SNAPSHOT.pom [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar: [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.90.0-SNAPSHOT/hbase-= 0.90.0-SNAPSHOT.jar [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar(test-jar): [ivy:resolve] http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.90.0-SNAPSHOT/hbase-= 0.90.0-SNAPSHOT.jar [ivy:resolve] =3D=3D=3D=3D datanucleus-repo: tried [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar: [ivy:resolve] http://www.datanucleus.org/downloads/maven2/org/apache/hbase/hbase/0.90.0-S= NAPSHOT/hbase-0.90.0-SNAPSHOT.jar [ivy:resolve] -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar(test-jar): [ivy:resolve] http://www.datanucleus.org/downloads/maven2/org/apache/hbase/hbase/0.90.0-S= NAPSHOT/hbase-0.90.0-SNAPSHOT.jar [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: [ivy:resolve] :: UNRESOLVED DEPENDENCIES :: [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: [ivy:resolve] :: org.apache.hbase#hbase;0.90.0-SNAPSHOT: not foun= d [ivy:resolve] :::::::::::::::::::::::::::::::::::::::::::::: Copying dev@hbase.apache.org for further comment. On Tue, Mar 22, 2011 at 8:40 AM, Jean-Charles Thomas < JCThomas@autoscout24.com> wrote: > Hi, > > > > I am using hbase 0.90 and Hive 0.7 and would like to try the hive/hbase > integration. From the Wiki Doc I could see that I have to rebuild the the > handler: > > > > =93If you are not using hbase-0.89.0, you will need to rebuild the handle= r > with the HBase jar matching your version, and change the --auxpath above > accordingly=94 > > > > Can someone explain in more details how this can be done? I unfortunately > only have a basic java knowledge. > > > > Thanks in advance, > > > > JC > --0023545bdbc0ebfa66049f15fe50 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Look at this line in ivy/libraries.properties:
hbase.version=3D0.89.0-SN= APSHOT

The jars would be downloaded to:
./build/ivy/lib/default/h= base-0.89.0-SNAPSHOT-tests.jar
./build/ivy/lib/default/hbase-0.89.0-SNAP= SHOT.jar

After changing hbase.version, I saw:

[ivy:resolve] :: problems s= ummary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve]=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0 module not found: org.apache.hbase#hbase;0.90.0-SNAPSHOT
[i= vy:resolve]=A0=A0 =3D=3D=3D=3D hadoop-source: tried
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar:
[ivy:resolve]=A0=A0=A0=A0 http://mirror.facebook.net/facebook/hive-deps/hadoop/core/hbase-0= .90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.jar
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar(test-jar):
[ivy:resolve]=A0=A0=A0=A0 http://mirror.facebook.net/facebook/hive-deps/hadoop/co= re/hbase-0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.jar
[ivy:resolve]=A0=A0 =3D=3D=3D=3D apache-snapshot: tried
[ivy:resolve]=A0= =A0=A0=A0 ht= tps://repository.apache.org/content/repositories/snapshots/org/apache/hbase= /hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.pom
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar:
[ivy:resolve]=A0=A0=A0=A0 https://repository.apache.org/content/reposit= ories/snapshots/org/apache/hbase/hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHO= T.jar
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar(test-jar):
[ivy:resolve]=A0=A0=A0=A0 https://repository.apache.org= /content/repositories/snapshots/org/apache/hbase/hbase/0.90.0-SNAPSHOT/hbas= e-0.90.0-SNAPSHOT-tests.jar
[ivy:resolve]=A0=A0 =3D=3D=3D=3D maven2: tried
[ivy:resolve]=A0=A0=A0=A0= http://repo1.maven.org/maven2/org/apache/h= base/hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.pom
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar:
[ivy:resolve]=A0=A0=A0=A0 h= ttp://repo1.maven.org/maven2/org/apache/hbase/hbase/0.90.0-SNAPSHOT/hbase-0= .90.0-SNAPSHOT.jar
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar(test-jar):
[ivy:resolve]=A0=A0=A0=A0 http://repo1.maven.org/maven2/org/apache/hbase/hbase/0.90.0-SNAPSH= OT/hbase-0.90.0-SNAPSHOT.jar
[ivy:resolve]=A0=A0 =3D=3D=3D=3D datanucleus-repo: tried
[ivy:resolve]= =A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHOT!hbase.jar:<= br>[ivy:resolve]=A0=A0=A0=A0 = http://www.datanucleus.org/downloads/maven2/org/apache/hbase/hbase/0.90.0-S= NAPSHOT/hbase-0.90.0-SNAPSHOT.jar
[ivy:resolve]=A0=A0=A0=A0 -- artifact org.apache.hbase#hbase;0.90.0-SNAPSHO= T!hbase.jar(test-jar):
[ivy:resolve]=A0=A0=A0=A0 http://www.datanucleus.org/downloads/maven2/org/apac= he/hbase/hbase/0.90.0-SNAPSHOT/hbase-0.90.0-SNAPSHOT.jar
[ivy:resolve]=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 :::::::::::::::::::::::::::::::= :::::::::::::::
[ivy:resolve]=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 ::=A0=A0=A0= =A0=A0=A0=A0=A0=A0 UNRESOLVED DEPENDENCIES=A0=A0=A0=A0=A0=A0=A0=A0 ::
[i= vy:resolve]=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 :::::::::::::::::::::::::::::::::= :::::::::::::
[ivy:resolve]=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 :: org.apache.hbase#hbase;0.90.= 0-SNAPSHOT: not found
[ivy:resolve]=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 ::::::= ::::::::::::::::::::::::::::::::::::::::

Copying dev@hbase.apache.org for further comment.

On Tue, Mar 22, 2011 at 8:40 AM, Jean-Charle= s Thomas <= JCThomas@autoscout24.com> wrote:

Hi,

=A0

I am using hbase 0.90 and Hive = 0.7 and would like to try the hive/hbase integration. From the Wiki Doc I could see that I have to rebuild the the handler:

=A0

=93If you are not using hbase-0= .89.0, you will need to rebuild the handler with the HBase jar matching your versi= on, and change the --auxpath above accordingly=94

=A0

Can someone explain in more det= ails how this can be done? I unfortunately only have a basic java knowledge.

=A0

Thanks in advance,

=A0

JC


--0023545bdbc0ebfa66049f15fe50--