hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Agarwal, Saurabh " <saurabh.agar...@citi.com>
Subject Hbase and Search Integration
Date Tue, 20 Mar 2012 13:38:59 GMT

Has anyone integrated search ( Luence, Solr or Elastic) with HBase?

We are implementing log search functionality using HBase. Through Flume, the logs from multiple
apps are getting streamed into HBase directly.

A very basic use case is to search a keyword for an application for a certain timeframe (
for example - last hour).

Our row key is app_id:timestamp and all log contents are stored in columns. We started with
Regex filter. It worked but do not provide the consistent result.

Now, we are exploring the index search capability in HBase. Our thought process is that first
create an inverted index table with row key - search documents and column - the row key of
the content table. The search will return all the row keys.

Additional requirement - We would like to limit the results for certain time frame. Second,
we would like to display only limited records in descending time order and come back for more
if user want to see more records.

Let me know if someone has integrated the search with HBase.


-----Original Message-----
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Monday, March 19, 2012 12:33 PM
To: user@hbase.apache.org
Subject: Re: There is no data value information in HLog?

Have you noticed this in HLogPrettyPrinter ?
    options.addOption("p", "printvals", false, "Print values");

Looks like you should have specified the above option.

On Mon, Mar 19, 2012 at 7:31 AM, yonghu <yongyong313@gmail.com> wrote:

> Hello,
> I used the $ ./bin/hbase org.apache.hadoop.hbase.regionserver.wal.HLog
> --dump command to check the HLog information. But I can not find any
> data information. The output of my HLog file is looks like follows:
> Sequence 933 from region 85986149309dff24ecf7be4873136f15 in table test
>  Action:
>    row: Udo
>    column: Course:Computer
>    at time: Mon Mar 19 14:09:29 CET 2012
> Sequence 935 from region 85986149309dff24ecf7be4873136f15 in table test
>  Action:
>    row: Udo
>    column: Course:Math
>    at time: Mon Mar 19 14:09:29 CET 2012
> The functionality of HLog is for recovery. But without data value
> information, how can hbase use the information in HLog to do recovery.
> My hbase version is 0.92.0.
> Regards!
> Yong

View raw message