hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jianwei Cui (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16423) Add re-compare option to VerifyReplication to avoid occasional inconsistent rows
Date Fri, 23 Sep 2016 07:14:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15515650#comment-15515650
] 

Jianwei Cui commented on HBASE-16423:
-------------------------------------

Thanks for the review [~tedyu], could you please take a look at the patch for branch-1?

> Add re-compare option to VerifyReplication to avoid occasional inconsistent rows
> --------------------------------------------------------------------------------
>
>                 Key: HBASE-16423
>                 URL: https://issues.apache.org/jira/browse/HBASE-16423
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>    Affects Versions: 2.0.0
>            Reporter: Jianwei Cui
>            Assignee: Jianwei Cui
>            Priority: Minor
>             Fix For: 2.0.0, 1.4.0
>
>         Attachments: HBASE-16423-branch-1-v1.patch, HBASE-16423-v1.patch, HBASE-16423-v2.patch,
HBASE-16423-v3.patch
>
>
> Because replication keeps eventually consistency, VerifyReplication may report inconsistent
rows if there are data being written to source or peer clusters during scanning. These occasionally
inconsistent rows will have the same data if we do the comparison again after a short period.
It is not easy to find the really inconsistent rows if VerifyReplication report a large number
of such occasionally inconsistency. To avoid this case, we can add an option to make VerifyReplication
read out the inconsistent rows again after sleeping a few seconds and re-compare the rows
during scanning. This behavior follows the eventually consistency of hbase's replication.
Suggestions and discussions are welcomed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message