hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15786) Create DBB backed MSLAB pool
Date Mon, 14 Nov 2016 07:19:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663026#comment-15663026

Anoop Sam John commented on HBASE-15786:

bq.MemorySizeUtil needs class comment explaining it. Don't you have a nice write up on how
this thing operators that you could copy/paste in here?
That is flush related decision points which is handled by another patch..  Will make sure
we have comments copied from the google doc there.

> Create DBB backed MSLAB pool
> ----------------------------
>                 Key: HBASE-15786
>                 URL: https://issues.apache.org/jira/browse/HBASE-15786
>             Project: HBase
>          Issue Type: Sub-task
>          Components: regionserver
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: Anoop Sam John
>             Fix For: 2.0.0
>         Attachments: HBASE-15786.patch
> We can make use of MSLAB pool for this off heap memstore. 
> Right now one can specify the global memstore size (heap size) as a % of max memory using
a config. We will add another config with which one can specify the global off heap memstore
size. This will be exact size not as %. When off heap memstore in use, we will give this entire
area for the MSLAB pool and that will create off heap chunks. So when cells are added to memstore,
the cell data gets copied into the off heap MSLAB chunk spaces. Note that when the pool size
is not really enough and we need additional chunk creation, we wont use off heap area for
that.  We dony want to create so many on demand DBBs.

This message was sent by Atlassian JIRA

View raw message