hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Clara Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-15181) A simple implementation of date based tiered compaction
Date Wed, 27 Jan 2016 20:02:39 GMT
Clara Xiong created HBASE-15181:

             Summary: A simple implementation of date based tiered compaction
                 Key: HBASE-15181
                 URL: https://issues.apache.org/jira/browse/HBASE-15181
             Project: HBase
          Issue Type: New Feature
          Components: Compaction
            Reporter: Clara Xiong
            Assignee: Clara Xiong
             Fix For: 2.0.0

This is a simple implementation of date-based tiered compaction similar to Cassandra's for
the following benefits:
1. Improve date-range-based scan by structuring store files in date-based tiered layout.
2. Reduce compaction overhead.
3. Improve TTL efficiency.

Perfect fit for the use cases that:
1. has mostly date-based date write and scan and a focus on the most recent data. 
2. never or rarely deletes data.

Out-of-order writes are handled gracefully so the data will still get to the right store file
for time-range-scan and re-compacton with existing store file in the same time window is handled
by ExploringCompactionPolicy.

Time range overlapping among store files is tolerated and the performance impact is minimized.

This message was sent by Atlassian JIRA

View raw message