hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12405) WAL accounting by Store
Date Wed, 24 Dec 2014 07:10:14 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258060#comment-14258060

stack commented on HBASE-12405:

bq. And there is a bug introduced by HBASE-10201, I think we need to make an addendum to fix
it rather than fix it in this patch.

Mind making a new issue altogether [~Apache9] and apply the fix there?  It will be a small
one but it is a bit late to add an addendum to HBASE-10201 (we usually say within 24 hours
or so for addendums else make new issue).  Thanks.

> WAL accounting by Store
> -----------------------
>                 Key: HBASE-12405
>                 URL: https://issues.apache.org/jira/browse/HBASE-12405
>             Project: HBase
>          Issue Type: Improvement
>          Components: wal
>    Affects Versions: 2.0.0, 1.1.0
>            Reporter: zhangduo
>            Assignee: zhangduo
>             Fix For: 2.0.0, 1.1.0
>         Attachments: HBASE-12405.patch, HBASE-12405_1.patch
> HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog,
so there are two problems:
> 1. We record minSeqId both in HRegion and FSHLog, which is a duplication.
> 2. There maybe holes in WAL accounting.
>     For example, assume family A with sequence id 1 and 3, family B with seqId 2. If
we flush family A, we can only record that WAL before sequence id 1 can be removed safely.
If we do a replay at this point, sequence id 3 will also be replayed which is unnecessary.

This message was sent by Atlassian JIRA

View raw message