hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bi,hongyu—mike <boyl...@gmail.com>
Subject Re: HBase MOB performance
Date Thu, 04 Sep 2014 06:30:41 GMT
btw, i disable the block cache for the hyperloglog table to avoid the cache
pollution


2014-09-04 14:29 GMT+08:00 Bi,hongyu—mike <boylook@gmail.com>:

> Hi all,
>
> we store serialised hyperloglog object into hbase by use of coprocessor,
> and the size distribution is below:
>    Row size (bytes):
>                min = 4279.00
>                max = 770757.00
>               mean = 67340.24
>             stddev = 153968.88
>             median = 14453.00
>               75% <= 63178.00
>               95% <= 336917.20
>               98% <= 761028.00
>               99% <= 767500.36
>             99.9% <= 770757.00
>              count = 827
>
> the this value will be update 400 times every minute but the regionserver
> where this table locate responsed slowly for other table's get request.
>
> In my option, write mob/blob should not bother the performance of reading
> other table's region in the same regionserver, only put pressure to hlog
> fsync,flush and compaction; right?
>
> thanks
>
> ps:
> hdfs blocksize=128MB
> memstore size=128MB
> max hlog=64
> low/high water: 0.35/0.4
> memstore percent:0.4
>
> heap size=32GB
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message