hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shengjie Min <kelvin....@gmail.com>
Subject Hbase filter-SubstringComparator vs full text search indexing
Date Mon, 10 Sep 2012 14:24:58 GMT
In my case, I have all the log events stored in HDFS/hbase in this format:

timestamp | priority | category | message body

Given I have only 4 fields here, that limits my queries to only against
these four. I am thinking about more advanced search like full text search
the message body. well, mainly substring query against message body.

   1.

   Has anybody tried to use Hbase SubstringComparator? How does it perform,
   with reasonable huge amount of data, can it still provide us the real time
   response capability?
   2.

   In my case, does it make more sene to use a proper full text search
   engine(lucene/solr/elasticsearch) to index the message body, does that
   sound like a better idea?

would be great someone experienced can share some stories here.

-Shengjie Min

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message