hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Geoffrey Jacoby (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-17912) Avoid major compactions on region server startup
Date Thu, 13 Apr 2017 19:01:41 GMT
Geoffrey Jacoby created HBASE-17912:

             Summary: Avoid major compactions on region server startup
                 Key: HBASE-17912
                 URL: https://issues.apache.org/jira/browse/HBASE-17912
             Project: HBase
          Issue Type: Improvement
          Components: Compaction
    Affects Versions: 0.98.24, 1.3.1, 2.0.0
            Reporter: Geoffrey Jacoby
            Assignee: Geoffrey Jacoby

The HRegionServer.CompactionChecker chore wakes up every 10s and for each store in each region
mods against a chore frequency (by default slightly under 3 hours) to see if it's time to
check if a major compaction is necessary for that store. 

The check to see if it needs to check for major compactions is calculated by 
    if (iteration % multiplier != 0) continue;

where iteration is the number of times the chore has woken up. 

Because 0 % anything is 0, this will always check for necessary major compactions on each
store when this chore is first run after the region server starts up. This can result in compaction
storms when doing a rolling restart, because, for example, the new instance of the region
server might get a lower jitter value than the old one had.

This message was sent by Atlassian JIRA

View raw message