hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sheetal Dolas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-12324) Improve compaction speed and process for immutable short lived datasets
Date Wed, 22 Oct 2014 21:03:34 GMT
Sheetal Dolas created HBASE-12324:
-------------------------------------

             Summary: Improve compaction speed and process for immutable short lived datasets
                 Key: HBASE-12324
                 URL: https://issues.apache.org/jira/browse/HBASE-12324
             Project: HBase
          Issue Type: New Feature
          Components: Compaction
    Affects Versions: 0.96.0, 0.98.0
            Reporter: Sheetal Dolas


We have seen multiple cases where HBase is used to store immutable data and the data lives
for short period of time (few days)
On very high volume systems, major compactions become very costly and slowdown ingestion rates.
In all such use cases (immutable data, high write rate and moderate read rates and shorter
ttl), avoiding any compactions and just deleting old data brings lot of performance benefits.

We should have a compaction policy that can only delete/archive files older than TTL and not
compact any files.

Also attaching a patch that can do so.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message