hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Biju Nair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-18532) Improve cache related stats rendered on RS UI
Date Tue, 08 Aug 2017 18:48:01 GMT

    [ https://issues.apache.org/jira/browse/HBASE-18532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16118847#comment-16118847
] 

Biju Nair commented on HBASE-18532:
-----------------------------------

The L1 and L2 cache stats are populated using [o.a.h.hbase.io.hfile.BlockCacheUtil.CachedBlocksByFile|https://github.com/apache/hbase/blob/rel/1.1.2/hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon#L300]
which in turn has a limit on the number of blocks which is set to [100000|https://github.com/apache/hbase/blob/rel/1.1.2/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.java#L191].
This seems to be causing the mismatch.  
Also is there a reason we are listing the 100K BC Bucket details on the UI. Does it help in
any way?  

> Improve cache related stats rendered on RS UI
> ---------------------------------------------
>
>                 Key: HBASE-18532
>                 URL: https://issues.apache.org/jira/browse/HBASE-18532
>             Project: HBase
>          Issue Type: Improvement
>          Components: regionserver, UI
>    Affects Versions: 1.1.2
>            Reporter: Biju Nair
>         Attachments: COMBINED-STATS.PNG, L1-STATS.PNG, L2-STATS.PNG
>
>
> The stats currently rendered for L1 and L2 cache are incorrect. Refer to the attached
screenshots of stats from a cluster showing the combined cache stats, L1 stats and L2 stats.
For e.g. the combined stats shows 38 GB used for cache while if we sum size of L1 and L2 cache
the value is way less. One way we can improve this is to use the same stats used to populate
the combined stats to render the values of L1 & L2 cache. Also for usability we can remove
the table with details with BucketCache buckets from the L2 cache stats since this is going
to be long for any installation using L2 cache. This will help in understanding the cache
usage better. Thoughts? If there are no concerns will submit a patch. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message