hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manjeet Singh <manjeet.chand...@gmail.com>
Subject How to avoid update blocking
Date Tue, 07 Feb 2017 05:15:19 GMT
How to avoid read/write update blocking in hbase and on what condition
Hbase block read/write?



what should the frequency of Major compaction ( I have daily data insert on
average is 18 GB and 48 GB max, its with SNAPPY and FAST_DIFF)

 a. should it be on daily basis?

 b. should it be in weekends?

 c. does Major compaction on daily basis will avoid blocking?


What is the calculation? Right now its on weekend when load is low.

we have :
total 7 (3+4) data nodes
3 80GB Ram 1.8TB HDD
4 125 GB Ram HDD 6 TB

below are few important configurations:

hbase.regionserver.global.memstore.lowerLimit = .38
hbase.regionserver.global.memstore.upperLimit = .4
hbase.hregion.memstore.block.multiplier=2
hbase.hregion.majorcompaction=0 ( scheduled on weekend)
hbase.hregion.memstore.flush.size 128 MB
hbase.hregion.preclose.flush.size 5 MB
hbase.hstore.compactionThreshold 3

-- 
luv all

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message