hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Hsieh (Issue Comment Edited) (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HBASE-5786) Implement histogram metrics for flush and compaction latencies and sizes.
Date Fri, 13 Apr 2012 23:27:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13253861#comment-13253861
] 

Jonathan Hsieh edited comment on HBASE-5786 at 4/13/12 11:26 PM:
-----------------------------------------------------------------

At least for the constant write load testing I'm doing currently, 1000 entries would are exhausted
in about 8 hours.  

The histogramming currently uses reservoir sampling (with 1000 slots) to keep metrics over
all time.  Forward biasing makes more recent entries favored.

With the sampling method we could keep reasonable metrics for longer periods of time (weeks).
                
      was (Author: jmhsieh):
    
At least for the constant write load testing I'm doing currently, 1000 entries would are exhausted
in about 8 hours.  

The histogramming currently uses reservoir sampling (with 100 slots) to keep metrics over
all time.  Forward biasing makes more recent entries favored.

With the sampling method we could keep reasonable metrics for longer periods of time (weeks).
                  
> Implement histogram metrics for flush and compaction latencies and sizes.
> -------------------------------------------------------------------------
>
>                 Key: HBASE-5786
>                 URL: https://issues.apache.org/jira/browse/HBASE-5786
>             Project: HBase
>          Issue Type: New Feature
>          Components: metrics, regionserver
>    Affects Versions: 0.92.2, 0.94.0, 0.96.0
>            Reporter: Jonathan Hsieh
>            Assignee: Shaneal Manek
>
> Average time for region operations doesn't really tell a useful story when that help
diagnose anomalous conditions.
> It would be extremely useful to add histogramming metrics similar to HBASE-5533 for region
operations like flush, compaction and splitting.  The probably should be forward biased at
a much coarser granularity however (maybe decay every day?) 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message