hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amit Sela <am...@infolinks.com>
Subject Controlling Region Server Heap usage
Date Wed, 13 Jun 2012 15:40:06 GMT
Hi all,

I'm working on a production cluster where each Region Server has 10GB
allocated memory, and I'm trying to control (limit) the memory usage during
massive writes.

HBase configurations are:
hbase.regionserver.handler.count 18
hbase.regionserver.global.memstore.upperLimit 0.5
hbase.regionserver.global.memstore.lowerLimit 0.45
hbase.server.thread.wakefrequency 500
hbase.hregion.memstore.flush.size 268435456 (256MB)
hbase.hregion.memstore.block.multiplier 5
hbase.hstore.blockingStoreFiles 12

As I understand things, when the heap usage of a Region Server reaches
the hbase.regionserver.global.memstore.upperLimit (5GB in this case), all
updates are blocked and all MemStores are flushed (until lowerLimit is
reached - 4.5GB in this case).

During massive writes to HBase I see some of the Region Servers constantly
(not just spikes) over 7GB and spiking to 9 from time to time.

Why is That ? is there anything wrong with the configurations I used ?
Is there a better way to control the Region Server memory usage ?

Thanks,

Amit.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message