hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2231) Compaction events should be written to HLog
Date Fri, 12 Mar 2010 00:56:27 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12844304#action_12844304

dhruba borthakur commented on HBASE-2231:

A offline discussion among Karthik and Arvind resulted in the idea that the master should
rename the directory where hlogs are written. It should then open the last file for "append"
to ensure that the old region server cannot write anymore to it. After that, the master is
free to safely process all the logs in the hlog directory.

This would need that the region server use org.apache.hadoop.fs.create() while crearing a
hlog file (which allows failing a create if any intermediate directory in the path is absent).

> Compaction events should be written to HLog
> -------------------------------------------
>                 Key: HBASE-2231
>                 URL: https://issues.apache.org/jira/browse/HBASE-2231
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Todd Lipcon
> The sequence for a compaction should look like this:
> # Compact region to "new" files
> # Write a "Compacted Region" entry to the HLog
> # Delete "old" files
> This deals with a case where the RS has paused between step 1 and 2 and the regions have
since been reassigned.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message