hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-9365) Limit major compactions to off peak hours
Date Wed, 28 Aug 2013 18:56:53 GMT
Lars Hofhansl created HBASE-9365:

             Summary: Limit major compactions to off peak hours
                 Key: HBASE-9365
                 URL: https://issues.apache.org/jira/browse/HBASE-9365
             Project: HBase
          Issue Type: Bug
            Reporter: Lars Hofhansl

We already have off peak hours (where we set a more aggressive compaction ratio) and periodic
major compactions.
It would be nice if we could limit this to off peak hours as well.

A major compaction can be triggered in three ways:
# a periodic chore checking every ~3h (10.000.000ms) by default
# a minor compaction promoted to major because the last major compaction was too long ago
# a minor compaction promoted to major (at the HStore level), because it touched all HFiles

For case #1 and #2 we could could optionally return false from Store.isMajorCompaction(...)
when we're not in the off peak window. Would have a new config option to enforce that only
In case #3 we're compacting all files anyway, so not need to interfere with that.


This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message