Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of jej2003@gmail.com designates
 209.85.219.219 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=hwFhUFovakRwGqUg0YoD4ABMVpwbZ5vcbOYOMbYr6UW6HmRlL82K18mqh+FmIQJXeG
         XYIjXy2rz/rDODHidCNUFEILm5PTeJ/DeMZ+fSQciXv8qiblqoQSAK8fV3npLq3kXwRY
         w+P9Oyczlm6VqicbHvw8pVkysCHLdMy7kmZ7M=
MIME-Version: 1.0
In-Reply-To: <32120a6a0905161331h53c5ea6dncb3b73fe846ec432@mail.gmail.com>
References: <43b459c10905161303r7828d1a2g2ae0f173c123f2a0@mail.gmail.com>
	 <32120a6a0905161331h53c5ea6dncb3b73fe846ec432@mail.gmail.com>
Date: Sat, 16 May 2009 20:31:24 -0400
Message-ID: <43b459c10905161731w2596e60p87394fc57c80b423@mail.gmail.com>
Subject: Re: hbase & lucene
From: Jamie Johnson <jej2003@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=0015174c1632340f19046a10cc43

--0015174c1632340f19046a10cc43
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Thanks, I am looking into this perhaps my question should have been a little
different though.

If I am starting from scratch, nothing in the DB and want to keep a Lucene
index for information I add in hbase is there a way to build the index on
insertion instead of running a map reduce task after it has been inserted?
Or is there a way to specify only to index files after a certain date so
this task can be run periodically instead of having to reindex everything?

Again I am very new to this so any help would be appreciated.

On Sat, May 16, 2009 at 4:31 PM, tim robertson <timrobertson100@gmail.com>wrote:

> There is an IndexTableReduce class in the HBase source that you might
> want to look at.
>
> Here is a basic example of usage:
>
>                BuildTableIndex bti = new BuildTableIndex();
>                JobConf conf = new JobConf(TestBuildLucene.class);
>                conf = bti.createJob(conf, 1, 1, "/tmp/lucene-hbase",
> "occurrence",
> "raw:CatalogueNo");
>                try {
>                        JobClient.runJob(conf);
>                } catch (IOException e) {
>                        e.printStackTrace();
>                }
>
>                // do a term query
>                try {
>                        IndexReader reader =
> IndexReader.open("/tmp/lucene-hbase/part-00000");
>
> Cheers,
> Tim
>
>
>
>
> On Sat, May 16, 2009 at 10:03 PM, Jamie Johnson <jej2003@gmail.com> wrote:
> > I have seen several pages (most over a year old) which make reference to
> > building lucene indexes against hbase, is there any updated documentation
> > which can be used to do this, or an old document which is still valid?  I
> am
> > new to the hbase world so any help on this would be greatly appreciated.
> >
> > Jamie
> >
>

--0015174c1632340f19046a10cc43--