hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhishek Singh Chouhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15134) Add visibility into Flush and Compaction queues
Date Tue, 11 Jul 2017 07:05:02 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081772#comment-16081772
] 

Abhishek Singh Chouhan commented on HBASE-15134:
------------------------------------------------

Thanks [~busbey] [~stack] . Since master has changed a bit after the patch, let me rebase/test
on the latest branches and get back on this. Also [~apurtell] would we like to have this in
branch-1.4 ?

> Add visibility into Flush and Compaction queues
> -----------------------------------------------
>
>                 Key: HBASE-15134
>                 URL: https://issues.apache.org/jira/browse/HBASE-15134
>             Project: HBase
>          Issue Type: New Feature
>          Components: Compaction, metrics, regionserver
>            Reporter: Elliott Clark
>            Assignee: Abhishek Singh Chouhan
>             Fix For: 2.0.0
>
>         Attachments: HBASE-15134.master.001.patch, HBASE-15134.master.002.patch, HBASE-15134.patch,
HBASE-15134.patch
>
>
> On busy spurts we can see regionservers start to see large queues for compaction. It's
really hard to tell if the server is queueing a lot of compactions for the same region, lots
of compactions for lots of regions, or just falling behind.
> For flushes much the same. There can be flushes in queue that aren't being run because
of delayed flushes. There's no way to know from the metrics how many flushes are for each
region, how many are delayed. Etc.
> We should add either more metrics around this ( num per region, max per region, min per
region ) or add on a UI page that has the list of compactions and flushes.
> Or both.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message