hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Virag Kothari (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11442) ReplicationSourceManager doesn't cleanup the queues for recovered sources
Date Thu, 10 Jul 2014 21:42:05 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14058000#comment-14058000
] 

Virag Kothari commented on HBASE-11442:
---------------------------------------

[~jdcryans] Can you take a look? Thxs

> ReplicationSourceManager doesn't cleanup the queues for recovered sources
> -------------------------------------------------------------------------
>
>                 Key: HBASE-11442
>                 URL: https://issues.apache.org/jira/browse/HBASE-11442
>             Project: HBase
>          Issue Type: Bug
>          Components: Replication
>            Reporter: Virag Kothari
>            Assignee: Virag Kothari
>         Attachments: HBASE-11442.patch, HBASE-11442_2.patch
>
>
> Currently, ReplicationSourceManager only cleanups the queues for recovered sources when
the queue is being closed. This can cause the already read WAL's files to be read again when
a region server doing failover also dies. This can cause replication to possibly happen again
> For e.g lets say RS1 dies with 5 files in queue and RS2 is doing the failover. Now, lets
say RS2 dies after going thru 3 files in queue and RS3 is doing the failover. In this case,
RS3 will again read those 3 files as they were not removed from the queue. (Though it will
read the first file from the set pos. in ZK)



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message