hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4089) blockCache contents report
Date Wed, 18 Jun 2014 06:38:11 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034880#comment-14034880
] 

Hudson commented on HBASE-4089:
-------------------------------

SUCCESS: Integrated in HBase-0.98 #345 (See [https://builds.apache.org/job/HBase-0.98/345/])
HBASE-11366 Backport HBASE-4089 (block cache contents report UI) to 0.98 (stack: rev da94cd398f9a0b1dc8d601a894314559e4f0939f)
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.java
* pom.xml
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileBlockCacheSummary.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/RandomSeek.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CombinedBlockCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheKey.java
* hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlock.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketAllocator.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/StateDumpServlet.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheStats.java
* hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheViewTmpl.jamon
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCacheStats.java
* hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
* hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlock.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java
* hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SlabCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/SimpleBlockCache.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestLruBlockCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSStatusServlet.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCachedBlockQueue.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlockQueue.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestBlockCacheColumnFamilySummary.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/FileIOEngine.java
* hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockPriority.java
* hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
* hbase-server/src/main/resources/hbase-webapps/master/table.jsp
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SingleSizeCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCachesIterator.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlockQueue.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/ByteBufferIOEngine.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheColumnFamilySummary.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/DoubleBlockCache.java
* hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/ServerMetricsTmpl.jamon


> blockCache contents report
> --------------------------
>
>                 Key: HBASE-4089
>                 URL: https://issues.apache.org/jira/browse/HBASE-4089
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Doug Meil
>            Assignee: stack
>             Fix For: 0.99.0
>
>         Attachments: 4089.wip.txt, 4089.wip.v2.txt, 4089v3.txt, 4089v4.txt, 4089v6.txt,
4089v7.txt, 4089v7.txt, 4089v8.txt, bc_basic.png, bc_bucketcache.png, bc_buckets.png, bc_config.png,
bc_l1.png, bc_l2_buckets.png, bc_showing_buckets_start.png, bc_slabs.png, bc_slabs.png, bc_stats.png,
hbase_4089_blockcachereport.pdf, java_blockcache_checkpoint_2011_08_11.patch
>
>
> Summarized block-cache report for a RegionServer would be helpful.  For example ...
> table1
>   cf1   100 blocks, totalBytes=yyyyy, averageTimeInCache=XXXX hours
>   cf2   200 blocks, totalBytes=zzzzz, averageTimeInCache=XXXX hours
> table2
>   cf1  75 blocks, totalBytes=yyyyy, averageTimeInCache=XXXX hours
>   cf2 150 blocks, totalBytes=zzzzz, averageTimeInCache=XXXX hours
> ... Etc.
> The current metrics list blockCacheSize and blockCacheFree, but there is no way to know
what's in there.  Any single block isn't really important, but the patterns of what CF/Table
they came from, how big are they, and how long (on average) they've been in the cache, are
important.
> No such interface exists in HRegionInterface.  But I think it would be helpful from an
operational perspective.
> Updated (7-29):  Removing suggestion for UI.  I would be happy just to get this report
on a configured interval dumped to a log file.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message