hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin O'dell" <kevin.od...@cloudera.com>
Subject Re: Clear Block Cache
Date Thu, 14 Jun 2012 17:59:56 GMT

  One way to do it would be to use a configuration parameter and just set
it to zero for those scans.  From the HBase book:

 Disabling Blockcache

Do not turn off block cache (You'd do it by
setting hbase.block.cache.size to zero). Currently we do not do well if you
do this because the regionserver will spend all its time loading hfile
indices over and over again. If your working set it such that block cache
does you no good, at least size the block cache such that hfile indices
will stay up in the cache (you can get a rough idea on the size you need by
surveying regionserver UIs; you'll see index block size accounted near the
top of the webpage).


On Thu, Jun 14, 2012 at 1:39 PM, Kevin <kevin.macksamie@gmail.com> wrote:
> Hello,
> I would like to get timing results for some large, rare scans, but each
> reading test keeps performing better because of the heap's LRU block
> Is there a way (possibly through the API) that I can clear the block cache
> to get timing results that mimic cold read times? I tried
> HTable.clearRegionCache() but that didn't seem to do anything in terms of
> making the scans taking longer.
> Thanks.

Kevin O'Dell
Customer Operations Engineer, Cloudera

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message