hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Clara Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-15181) A simple implementation of date based tiered compaction
Date Wed, 27 Jan 2016 20:02:39 GMT
Clara Xiong created HBASE-15181:
-----------------------------------

             Summary: A simple implementation of date based tiered compaction
                 Key: HBASE-15181
                 URL: https://issues.apache.org/jira/browse/HBASE-15181
             Project: HBase
          Issue Type: New Feature
          Components: Compaction
            Reporter: Clara Xiong
            Assignee: Clara Xiong
             Fix For: 2.0.0


This is a simple implementation of date-based tiered compaction similar to Cassandra's for
the following benefits:
1. Improve date-range-based scan by structuring store files in date-based tiered layout.
2. Reduce compaction overhead.
3. Improve TTL efficiency.

Perfect fit for the use cases that:
1. has mostly date-based date write and scan and a focus on the most recent data. 
2. never or rarely deletes data.

Out-of-order writes are handled gracefully so the data will still get to the right store file
for time-range-scan and re-compacton with existing store file in the same time window is handled
by ExploringCompactionPolicy.

Time range overlapping among store files is tolerated and the performance impact is minimized.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message