hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Spiegelberg (JIRA)" <j...@apache.org>
Subject [jira] Created: (HBASE-3319) Add File Count Threshold to HBCK
Date Wed, 08 Dec 2010 00:32:01 GMT
Add File Count Threshold to HBCK

                 Key: HBASE-3319
                 URL: https://issues.apache.org/jira/browse/HBASE-3319
             Project: HBase
          Issue Type: Improvement
          Components: util
            Reporter: Nicolas Spiegelberg
            Priority: Minor

A useful check to add to HBCK is a way to estimate the max # of files that a cluster should
have and raise a warning/error if the file count goes above that threshold.   We ran into
an issue this week where our ".oldlogs" folder filled up to 100k files because 'hbase.master.logcleaner.maxdeletedlogs"
was set too low.  We found this because of faulty region count metric in the HTTP server that
actually showed the file count.  Adding an HBCK check would provide an extra layer of detection
to find leaks from new features or conservatively configured cleanup thresholds.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message