hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11442) ReplicationSourceManager doesn't cleanup the queues for recovered sources
Date Mon, 30 Jun 2014 23:43:24 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14048315#comment-14048315

Ted Yu commented on HBASE-11442:


Please wrap long lines.

> ReplicationSourceManager doesn't cleanup the queues for recovered sources
> -------------------------------------------------------------------------
>                 Key: HBASE-11442
>                 URL: https://issues.apache.org/jira/browse/HBASE-11442
>             Project: HBase
>          Issue Type: Bug
>          Components: Replication
>            Reporter: Virag Kothari
>            Assignee: Virag Kothari
>         Attachments: HBASE-11442.patch
> Currently, ReplicationSourceManager only cleanups the queues for recovered sources when
the queue is being closed. This can cause the already read WAL's files to be read again when
a region server doing failover also dies. This can cause replication to possibly happen again
> For e.g lets say RS1 dies with 5 files in queue and RS2 is doing the failover. Now, lets
say RS2 dies after going thru 3 files in queue and RS3 is doing the failover. In this case,
RS3 will again read those 3 files as they were not removed from the queue. (Though it will
read the first file from the set pos. in ZK)

This message was sent by Atlassian JIRA

View raw message