hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-9365) Limit major compactions to off peak hours
Date Wed, 28 Aug 2013 18:56:53 GMT
Lars Hofhansl created HBASE-9365:
------------------------------------

             Summary: Limit major compactions to off peak hours
                 Key: HBASE-9365
                 URL: https://issues.apache.org/jira/browse/HBASE-9365
             Project: HBase
          Issue Type: Bug
            Reporter: Lars Hofhansl


We already have off peak hours (where we set a more aggressive compaction ratio) and periodic
major compactions.
It would be nice if we could limit this to off peak hours as well.

A major compaction can be triggered in three ways:
# a periodic chore checking every ~3h (10.000.000ms) by default
# a minor compaction promoted to major because the last major compaction was too long ago
# a minor compaction promoted to major (at the HStore level), because it touched all HFiles
anyway

For case #1 and #2 we could could optionally return false from Store.isMajorCompaction(...)
when we're not in the off peak window. Would have a new config option to enforce that only
optionally.
In case #3 we're compacting all files anyway, so not need to interfere with that.

Thoughts?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message