hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Renaud Delbru <renaud.del...@deri.org>
Subject Re: Meaning of storefileIndexSize
Date Tue, 18 May 2010 09:15:22 GMT

after some tuning, like increasing the hfile block size to 128KB,  I 
have noticed that the storefileIndexSize is now half of what it was 
before (~250). Do storefileIndexSize is the size of the in-memory hfile 
block index ?

Renaud Delbru

On 17/05/10 15:27, Renaud Delbru wrote:
> Hi,
> I would like to understand the meaning of the storefileIndexSize 
> metric, could someone point me to a definition or explain me what does 
> that mean ?
> Also, we are performing a large table import (90M rows, size of the 
> row varying between hundreds of kb to 8 MB), and we are encountering 
> memory problem (OOME). My observation is that it always happens after 
> a while, when the storefileIndexSize starts to be large (> 500). Is 
> there a way to reduce it ?
> Thanks,

View raw message