hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@apache.org>
Subject Re: Lucene's FST for the block index
Date Thu, 02 Jun 2011 16:24:18 GMT
> It would be nice to support pluggable block index
> implementations.

+1

Perhaps we do this in the scope of HFile "v2"? https://issues.apache.org/jira/browse/HBASE-3857

  - Andy


--- On Thu, 6/2/11, Ted Yu <yuzhihong@gmail.com> wrote:

> From: Ted Yu <yuzhihong@gmail.com>
> Subject: Re: Lucene's FST for the block index
> To: dev@hbase.apache.org
> Date: Thursday, June 2, 2011, 9:20 AM
> Currently BlockIndex is an inner
> class of HFile.
> It would be nice to support pluggable block index
> implementations.
> 
> FYI
> 
> On Thu, Jun 2, 2011 at 9:09 AM, Jason Rutherglen <jason.rutherglen@gmail.com
> > wrote:
> 
> > Lucene has a compact FST (Finite State Transducer)
> that's used for the
> > sorted terms index.  I think this is the same
> type of functionality as
> > the HBase block index, eg, a sorted index of row
> ids?  The FST is more
> > compact keeping every Nth row id in RAM.  Does
> the HFile format allow
> > pluggable block index implementations?
> >
> > I posted this to Jira issues however that's probably
> not the best place.
> >
> 

Mime
View raw message