hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Appy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16524) Clean procedure wal periodically instead of on every sync
Date Tue, 06 Sep 2016 22:00:23 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468754#comment-15468754

Appy commented on HBASE-16524:

Thinking about it, that should be easy to do. 
In our current logic, we basically do this:
1. make a copy of current global tracker, say T.
2. Iterate over log files:
        - keep the file if contain an update to proc P which is not marked deleted in T.
        - Delete P from T so we don't hold another older log file because of it.

We can simply add step 0, which marks all recently updated procs as deleted in T.
Sounds good?

> Clean procedure wal periodically instead of on every sync
> ---------------------------------------------------------
>                 Key: HBASE-16524
>                 URL: https://issues.apache.org/jira/browse/HBASE-16524
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Appy
>            Assignee: Appy
>            Priority: Minor
>         Attachments: HBASE-16524.master.001.patch, flame1.svg

This message was sent by Atlassian JIRA

View raw message