hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Clara Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15454) Archive store files older than max age
Date Tue, 12 Apr 2016 04:39:25 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15236572#comment-15236572

Clara Xiong commented on HBASE-15454:

Thanks to [~davelatham] I left some comments on RB. But I have the same bigger questions you

In general, I like the idea of extending window class but I am concerned about mingling needsCompaction/needsArchive
and selectCompaction/selectArchive. DTCP has already provided a way to archive data, except
that it is not by calendar windows. I understand for some use cases, people may want calendar
windows than exponential ones. Extending window class is a good idea. If that is not enough,
we can have a separate policy that takes calendar windows for minor, major and archive. It
can share some logic from DTCP. 

> Archive store files older than max age
> --------------------------------------
>                 Key: HBASE-15454
>                 URL: https://issues.apache.org/jira/browse/HBASE-15454
>             Project: HBase
>          Issue Type: Sub-task
>          Components: Compaction
>    Affects Versions: 2.0.0, 1.3.0, 0.98.18, 1.4.0
>            Reporter: Duo Zhang
>            Assignee: Duo Zhang
>             Fix For: 2.0.0, 1.3.0, 0.98.19, 1.4.0
>         Attachments: HBASE-15454-v1.patch, HBASE-15454.patch
> Sometimes the old data is rarely touched but we can not remove it. So archive it to several
big files(by year or something) and use EC to reduce the redundancy.

This message was sent by Atlassian JIRA

View raw message