hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Himanshu Vashishtha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8741) Scope sequenceid to the region rather than regionserver (WAS: Mutations on Regions in recovery mode might have same sequenceIDs)
Date Fri, 25 Oct 2013 19:12:32 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13805607#comment-13805607
] 

Himanshu Vashishtha commented on HBASE-8741:
--------------------------------------------

The above link to findbugs failure gives 404; I ran test-patch script and it gives +1 to findbugs.
{code}
./dev-support/test-patch.sh ~/patches/HBASE-8741-trunk-v6.2.1.patch
{code}

Output:
{code}

{color:red}-1 overall{color}.  
    {color:green}+1 @author{color}.  The patch does not contain any @author tags.
    {color:green}+1 tests included{color}.  The patch appears to include 36 new or modified
tests.
    {color:green}+1 hadoop1.0{color}.  The patch compiles against the hadoop 1.0 profile.
    {color:green}+1 hadoop2.0{color}.  The patch compiles against the hadoop 2.0 profile.
    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.
    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.
    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
) warnings.
    {color:red}-1 release audit{color}.  The applied patch generated 9 release audit warnings
(more than the trunk's current 0 warnings).
    {color:green}+1 lineLengths{color}.  The patch does not introduce lines longer than 100
    {color:red}-1 site{color}.  The patch appears to cause mvn site goal to fail.
{code}

Let me re-add it here.

> Scope sequenceid to the region rather than regionserver (WAS: Mutations on Regions in
recovery mode might have same sequenceIDs)
> --------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-8741
>                 URL: https://issues.apache.org/jira/browse/HBASE-8741
>             Project: HBase
>          Issue Type: Bug
>          Components: MTTR
>    Affects Versions: 0.95.1
>            Reporter: Himanshu Vashishtha
>            Assignee: Himanshu Vashishtha
>             Fix For: 0.98.0
>
>         Attachments: HBASE-8741-trunk-v6.1-rebased.patch, HBASE-8741-trunk-v6.2.1.patch,
HBASE-8741-trunk-v6.patch, HBASE-8741-v0.patch, HBASE-8741-v2.patch, HBASE-8741-v3.patch,
HBASE-8741-v4-again.patch, HBASE-8741-v4-again.patch, HBASE-8741-v4.patch, HBASE-8741-v5-again.patch,
HBASE-8741-v5.patch
>
>
> Currently, when opening a region, we find the maximum sequence ID from all its HFiles
and then set the LogSequenceId of the log (in case the later is at a small value). This works
good in recovered.edits case as we are not writing to the region until we have replayed all
of its previous edits. 
> With distributed log replay, if we want to enable writes while a region is under recovery,
we need to make sure that the logSequenceId > maximum logSequenceId of the old regionserver.
Otherwise, we might have a situation where new edits have same (or smaller) sequenceIds. 
> We can store region level information in the WALTrailer, than this scenario could be
avoided by:
> a) reading the trailer of the "last completed" file, i.e., last wal file which has a
trailer and,
> b) completely reading the last wal file (this file would not have the trailer, so it
needs to be read completely).
> In future, if we switch to multi wal file, we could read the trailer for all completed
WAL files, and reading the remaining incomplete files.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message