hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin O'dell" <kevin.od...@cloudera.com>
Subject Re: hbase set memstore size to 0
Date Sun, 03 Aug 2014 18:26:51 GMT
Hi Ozhang,

  If you are only bulk loading into HBase, then memstore flush size should
not matter. You most likely you looking to lower the upper/global memstore
limits.
On Aug 3, 2014 2:23 PM, "ozhang" <ozhangulen@gmail.com> wrote:

> Hello,
> In our hbase cluster memstore flush size is 128 mb. And to insert data to
> tables, we only use bulk load tool. Since bulk loading bypasses memstores,
> they are never used, so we want to minimize memstore flush size. But
> memstore flush size is used in many important calculations in hbase such
> that;
>
> region split size = Min (R^2 * “hbase.hregion.memstore.flush.size”,
> “hbase.hregion.max.filesize”)
>
> So setting memstore value smaller or "0" for example,  results in some
> other
> problems.
> What do you suggest us in that case. Setting memstore size to 128 holds
> some
> memory for tens of regions in region server and we want to get rid of it.
> Thanks a lot.
>
> ozhan
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/hbase-set-memstore-size-to-0-tp4062257.html
> Sent from the HBase User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message