hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ramkrishna vasudevan <ramkrishna.s.vasude...@gmail.com>
Subject Re: Optimizations for a Read-only database
Date Fri, 17 Mar 2017 17:40:01 GMT

Default memstore is 0.42 of the heap size. You can just make it 0.1 and
rest give to block cache. It will ensure that you have maximum data in the
block cache.  It is better for reads. In case of latest trunk you can even
use bucket cache in offheap mode but as it is not available as a release
you may not be able to make use of it.

How many hfiles do you expect to be loaded. If it is not too many you can
disable the major compaction.

BTW which version are you using?


On Fri, Mar 17, 2017 at 11:02 PM, jeff saremi <jeffsaremi@hotmail.com>

> We're creating a readonly database and would like to know the recommended
> optimizations we could do. We'd be loading data via direct write to HFiles.
> One thing i could immediately think of is to eliminate the memory for
> Memstore. What is the minimum that we could get away with?
> How about disabling some regular operations to save CPU time. I think
> Compaction is one of those we'd like to stop.
> thanks
> Jeff

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message