Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 5B27D200B87 for ; Mon, 19 Sep 2016 08:49:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 59B6E160ADC; Mon, 19 Sep 2016 06:49:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 9A645160ACC for ; Mon, 19 Sep 2016 08:49:22 +0200 (CEST) Received: (qmail 45447 invoked by uid 500); 19 Sep 2016 06:49:21 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 45153 invoked by uid 99); 19 Sep 2016 06:49:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Sep 2016 06:49:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 78B0A2C0D59 for ; Mon, 19 Sep 2016 06:49:21 +0000 (UTC) Date: Mon, 19 Sep 2016 06:49:21 +0000 (UTC) From: "Abhishek Singh Chouhan (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-15134) Add visibility into Flush and Compaction queues MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Mon, 19 Sep 2016 06:49:23 -0000 [ https://issues.apache.org/jira/browse/HBASE-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502503#comment-15502503 ] Abhishek Singh Chouhan commented on HBASE-15134: ------------------------------------------------ Test HRegion passes reliably for me locally. As for the other timed out tests, i see them timing out on other builds too (https://builds.apache.org/job/PreCommit-HBASE-Build/3593/console , build 3592 etc.) > Add visibility into Flush and Compaction queues > ----------------------------------------------- > > Key: HBASE-15134 > URL: https://issues.apache.org/jira/browse/HBASE-15134 > Project: HBase > Issue Type: New Feature > Components: Compaction, metrics, regionserver > Reporter: Elliott Clark > Assignee: Abhishek Singh Chouhan > Attachments: HBASE-15134.master.001.patch, HBASE-15134.master.002.patch, HBASE-15134.patch, HBASE-15134.patch > > > On busy spurts we can see regionservers start to see large queues for compaction. It's really hard to tell if the server is queueing a lot of compactions for the same region, lots of compactions for lots of regions, or just falling behind. > For flushes much the same. There can be flushes in queue that aren't being run because of delayed flushes. There's no way to know from the metrics how many flushes are for each region, how many are delayed. Etc. > We should add either more metrics around this ( num per region, max per region, min per region ) or add on a UI page that has the list of compactions and flushes. > Or both. -- This message was sent by Atlassian JIRA (v6.3.4#6332)