Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of timrobertson100@gmail.com
 designates 209.85.215.48 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=kr2e+1ZKaJd3Ohuk7DqQ2NCO8uHzq2lVBxZ/gw8HIAs2aLaFv454bL8zdBvlgPU+eK
         1IY809vqnyxN8I4lERO5Uz0sUt+0NqLBZDjF0AyZlaWVqqt054z6Bs0pDBBs5C+Rwvdj
         sD+oqTYfm2/onwB3XcGSVCosMlZgHLKz01Gcs=
MIME-Version: 1.0
In-Reply-To: <341537.7552.qm@web50308.mail.re2.yahoo.com>
References: <341537.7552.qm@web50308.mail.re2.yahoo.com>
Date: Wed, 13 Oct 2010 22:45:31 +0200
Message-ID: <AANLkTinKbB5pV-+EkYS_aX7=zjjqqXfwN+1H7CgciAxo@mail.gmail.com>
Subject: Re: HBase as input AND output?
From: Tim Robertson <timrobertson100@gmail.com>
To: user@hive.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

That's right.  Hive can use an HBase table as an input format to the
hive query regardless of output format, and can also write the output
to an HBase table regardless of the input format.  You can also
supposedly do a join in Hive that uses 1 side of the join from an
HBase table, and the other side a text file, which is very powerful.
I haven't done it myself, but intend to shortly.

HTH,
Tim


On Wed, Oct 13, 2010 at 10:07 PM, Otis Gospodnetic
<otis_gospodnetic@yahoo.com> wrote:
> Hi,
>
> I was wondering how I can query data stored in HBase and remembered Hive'=
s HBase
> integration:
> http://wiki.apache.org/hadoop/Hive/HBaseIntegration
>
> After watching John Sichi's video
> (http://developer.yahoo.com/blogs/hadoop/posts/2010/04/hundreds_of_hadoop=
_fans_at_the/
> =A0) I have a better idea about what functionality this integration provi=
des, but
> I still have some questions.
>
> Would it be correct to say that Hive-HBase integration makes the followin=
g data
> flow possible:
>
> 0) Hive or Files =3D> Custom HQL statement that aggregates data =A0=3D=3D=
> HBase
> 1) HBase =3D=3D> Custom HQL statement that aggregates data =A0=3D=3D> HBa=
se
> 2) HBase =3D=3D> Custom HQL statement that aggregates data =A0=3D=3D> out=
put (console?)
>
> Of the above, 1) is what I'm wondering the most about right now.
>
> In other words, it seems to me that Hive may be able to look at *just* da=
ta
> stored in HBase *without* the typical data/files in HDFS that Hive normal=
ly runs
> its MR jobs against.
>
> Is this correct?
>
> Thanks,
> Otis
> ----
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
> Hadoop ecosystem search :: http://search-hadoop.com/
>
>