hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Rutherglen <jason.rutherg...@gmail.com>
Subject Re: Pluggable block index
Date Mon, 06 Jun 2011 16:07:41 GMT
> Are you sure that is a good idea?  Surely the disk seeks would destroy
> you on index load?

I'm not sure what you mean there.  We can create a total HFile block
key index that has pointers to within blocks, eg, they'll store a
block index int, and a position (within the block) int.  Where would
the index load occur as this method should allow faster key lookup?

On Sun, Jun 5, 2011 at 11:37 PM, Ryan Rawson <ryanobjc@gmail.com> wrote:
> On Sun, Jun 5, 2011 at 11:33 PM, Jason Rutherglen
> <jason.rutherglen@gmail.com> wrote:
>> Ok, the block index is only storing the first key of each block?
>> Hmm... I think we can store a pointer to an exact position in the
>> block, or at least allow that (for the FST implementation).
>
> Are you sure that is a good idea?  Surely the disk seeks would destroy
> you on index load?
>

Mime
View raw message