hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu Li (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17204) Make L2 off heap cache default ON
Date Wed, 30 Nov 2016 14:58:58 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708801#comment-15708801
] 

Yu Li commented on HBASE-17204:
-------------------------------

+1 on turning L2 off heap cache ON.

We're using 42GB on heap size with 12GB offheap cache here in Alibaba search. But according
to our [ref guide|http://hbase.apache.org/book.html#ops.capacity.nodes.gc] we are recommending
~20-24GB or less memory dedicated to one RS. Plus the default value of {{hfile.block.cache.size}}
set to 0.4, maybe set default size of off heap size to 8-10GB is a good idea?

> Make L2 off heap cache default ON
> ---------------------------------
>
>                 Key: HBASE-17204
>                 URL: https://issues.apache.org/jira/browse/HBASE-17204
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 2.0.0
>            Reporter: Anoop Sam John
>            Assignee: Anoop Sam John
>             Fix For: 2.0.0
>
>
> L2 cache can be used for data blocks.  By default it is off now. After HBASE-11425 work,
L2 off heap cache can equally perform with L1 on heap cache. On heavy loaded workload, this
can even out perform L1 cache.  Pls see recently published report by Alibaba.  Also this work
was backported by Rocketfuel and similar perf improvement report from them too.
> Let us turn L2 off heap cache ON. As it is off heap, we can have much larger sized L2
BC.  What should be the default size?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message