Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Date: Fri, 13 Apr 2012 23:27:18 +0000 (UTC)
From: "Jonathan Hsieh (Issue Comment Edited) (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Message-ID: 
 <1678975291.24376.1334359638897.JavaMail.tomcat@hel.zones.apache.org>
In-Reply-To: 
 <854282587.23980.1334355316814.JavaMail.tomcat@hel.zones.apache.org>
Subject: [jira] [Issue Comment Edited] (HBASE-5786) Implement histogram
 metrics for flush and compaction latencies and sizes.
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253861#comment-13253861 ] 

Jonathan Hsieh edited comment on HBASE-5786 at 4/13/12 11:26 PM:
-----------------------------------------------------------------

At least for the constant write load testing I'm doing currently, 1000 entries would are exhausted in about 8 hours.  

The histogramming currently uses reservoir sampling (with 1000 slots) to keep metrics over all time.  Forward biasing makes more recent entries favored.

With the sampling method we could keep reasonable metrics for longer periods of time (weeks).
                
      was (Author: jmhsieh):
    
At least for the constant write load testing I'm doing currently, 1000 entries would are exhausted in about 8 hours.  

The histogramming currently uses reservoir sampling (with 100 slots) to keep metrics over all time.  Forward biasing makes more recent entries favored.

With the sampling method we could keep reasonable metrics for longer periods of time (weeks).
                  
> Implement histogram metrics for flush and compaction latencies and sizes.
> -------------------------------------------------------------------------
>
>                 Key: HBASE-5786
>                 URL: https://issues.apache.org/jira/browse/HBASE-5786
>             Project: HBase
>          Issue Type: New Feature
>          Components: metrics, regionserver
>    Affects Versions: 0.92.2, 0.94.0, 0.96.0
>            Reporter: Jonathan Hsieh
>            Assignee: Shaneal Manek
>
> Average time for region operations doesn't really tell a useful story when that help diagnose anomalous conditions.
> It would be extremely useful to add histogramming metrics similar to HBASE-5533 for region operations like flush, compaction and splitting.  The probably should be forward biased at a much coarser granularity however (maybe decay every day?) 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira