hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Clara Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15454) Archive store files older than max age
Date Thu, 14 Apr 2016 20:34:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241858#comment-15241858

Clara Xiong commented on HBASE-15454:

For major compaction, we have a laundry list of checks which is in shouldPerformMajorCompaction
to determine whether we should do major compaction at a CompactionChecker run. You probably
want that too for this special compaction. And in SortedCompactionPolicy.selectCompaction,
we spend the effort to determin whether we can actually do major compaction: fileCompacting,
reference, file count < max file allowed. Please have the logic there than passing in candidate

Or if you believe this compaction is mutually exclusive/interchangeable with major compaction.
which IS as I understand from my interpretation, you can even make it interchangeable with
major compaction with a config switch so you use use/extend the logic for triggering. 

> Archive store files older than max age
> --------------------------------------
>                 Key: HBASE-15454
>                 URL: https://issues.apache.org/jira/browse/HBASE-15454
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Compaction
>    Affects Versions: 2.0.0, 1.3.0, 0.98.18, 1.4.0
>            Reporter: Duo Zhang
>            Assignee: Duo Zhang
>             Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0
>         Attachments: HBASE-15454-v1.patch, HBASE-15454-v2.patch, HBASE-15454-v3.patch,
> Sometimes the old data is rarely touched but we can not remove it. So archive it to several
big files(by year or something) and use EC to reduce the redundancy.

This message was sent by Atlassian JIRA

View raw message