hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17204) Make L2 off heap cache default ON
Date Wed, 30 Nov 2016 17:43:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709232#comment-15709232

stack commented on HBASE-17204:

We can come out w/ new defaults for 2.0 (with refguide appropriately updated).

+1 on enabling by default.

We need to do a bit of work though first.

We need to decide on a new config., direct memory size in MB/G. The L2 is some proportion
of this.

If L2, then L1 should be shrunk.

If L2, then heap should be smaller?

Do we need a 'configure' that spits out basic templates for hbase-env.sh? Or a file sourced
by hbase-env.sh that has in it heap, offheap, sizings set?

Then there is the L2 BucketCache itself. It needs a bit of work. HBASE-15240 has some outstanding
items (Let me add a few more I have from working notes kept around last time I messed w/ bucketcache).

> Make L2 off heap cache default ON
> ---------------------------------
>                 Key: HBASE-17204
>                 URL: https://issues.apache.org/jira/browse/HBASE-17204
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 2.0.0
>            Reporter: Anoop Sam John
>            Assignee: Anoop Sam John
>             Fix For: 2.0.0
> L2 cache can be used for data blocks.  By default it is off now. After HBASE-11425 work,
L2 off heap cache can equally perform with L1 on heap cache. On heavy loaded workload, this
can even out perform L1 cache.  Pls see recently published report by Alibaba.  Also this work
was backported by Rocketfuel and similar perf improvement report from them too.
> Let us turn L2 off heap cache ON. As it is off heap, we can have much larger sized L2
BC.  What should be the default size?

This message was sent by Atlassian JIRA

View raw message