hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15134) Add visibility into Flush and Compaction queues
Date Fri, 28 Jul 2017 12:13:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104868#comment-16104868
] 

Hudson commented on HBASE-15134:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-2.0 #248 (See [https://builds.apache.org/job/HBase-2.0/248/])
HBASE-15134 Add visibility into Flush and Compaction queues (achouhan: rev 12b9a151e6338297b253ca2e005eda22b1f2da4e)
* (edit) hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapper.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegion.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapperStub.java
* (edit) hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionSource.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionWrapperImpl.java
* (edit) hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionSourceImpl.java
* (edit) hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsRegionSourceImpl.java


> Add visibility into Flush and Compaction queues
> -----------------------------------------------
>
>                 Key: HBASE-15134
>                 URL: https://issues.apache.org/jira/browse/HBASE-15134
>             Project: HBase
>          Issue Type: New Feature
>          Components: Compaction, metrics, regionserver
>            Reporter: Elliott Clark
>            Assignee: Abhishek Singh Chouhan
>             Fix For: 3.0.0, 1.4.0, 1.5.0, 2.0.0-alpha-2
>
>         Attachments: HBASE-15134.branch-1.001.patch, HBASE-15134.branch-1.001.patch,
HBASE-15134.master.001.patch, HBASE-15134.master.002.patch, HBASE-15134.master.003.patch,
HBASE-15134.patch, HBASE-15134.patch
>
>
> On busy spurts we can see regionservers start to see large queues for compaction. It's
really hard to tell if the server is queueing a lot of compactions for the same region, lots
of compactions for lots of regions, or just falling behind.
> For flushes much the same. There can be flushes in queue that aren't being run because
of delayed flushes. There's no way to know from the metrics how many flushes are for each
region, how many are delayed. Etc.
> We should add either more metrics around this ( num per region, max per region, min per
region ) or add on a UI page that has the list of compactions and flushes.
> Or both.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message