hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-5189) Add metrics to keep track of region-splits in RS
Date Sat, 28 Jul 2012 20:41:34 GMT

     [ https://issues.apache.org/jira/browse/HBASE-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Matteo Bertozzi updated HBASE-5189:

    Attachment: HBASE-5189-persistent.patch

>From the MetricsTimeVaryingLong documentation:
The metrics is accumulated over an interval (set in the metrics config file); the metrics
is published at the end of each interval and then reset to zero. 

This means that the region split count doesn't contains the total number of splits but just
the diff between the previous time.

Given that the counter will be most of the time zero, if there're no continuous split.

Can't we just use a MetricsLongValue to keep track of the number of split, or since we're
at this point we can use a PersistentMetricsTimeVaryingRate to keep track of the avg time
of the splits? (patch attached)

Can someone comment on the original idea/use case of the region split counter?
> Add metrics to keep track of region-splits in RS
> ------------------------------------------------
>                 Key: HBASE-5189
>                 URL: https://issues.apache.org/jira/browse/HBASE-5189
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics, regionserver
>    Affects Versions: 0.90.5, 0.92.0
>            Reporter: Mubarak Seyed
>            Assignee: Mubarak Seyed
>            Priority: Minor
>              Labels: noob
>             Fix For: 0.94.0
>         Attachments: HBASE-5189-persistent.patch, HBASE-5189.trunk.v1.patch, HBASE-5189.trunk.v2.patch
> For write-heavy workload with region-size 1 GB, region-split is considerably high. We
do normally grep the NN log (grep "mkdir*.split" NN.log | sort | uniq -c) to get the count.
> I would like to have a counter incremented each time region-split execution succeeds
and this counter exposed via the metrics stuff in HBase.
> - regionSplitSuccessCount
> - regionSplitFailureCount (will help us to correlate the timestamp range in RS logs across
all RS)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message