hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14953) HBaseInterClusterReplicationEndpoint: Do not retry the whole batch of edits in case of RejectedExecutionException
Date Sat, 12 Dec 2015 03:24:46 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053999#comment-15053999
] 

Hudson commented on HBASE-14953:
--------------------------------

SUCCESS: Integrated in HBase-1.3 #433 (See [https://builds.apache.org/job/HBase-1.3/433/])
HBASE-14953 Replication: retry on RejectedExecutionException (eclark: rev 9e6acffca07b0d0206c8a5686347687050223de9)
* hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/HBaseInterClusterReplicationEndpoint.java


> HBaseInterClusterReplicationEndpoint: Do not retry the whole batch of edits in case of
RejectedExecutionException
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-14953
>                 URL: https://issues.apache.org/jira/browse/HBASE-14953
>             Project: HBase
>          Issue Type: Bug
>          Components: Replication
>    Affects Versions: 2.0.0, 1.2.0, 1.3.0
>            Reporter: Ashu Pachauri
>            Assignee: Ashu Pachauri
>            Priority: Critical
>             Fix For: 2.0.0, 1.2.0, 1.3.0
>
>         Attachments: HBASE-14953-V1.patch, HBASE-14953-V2.patch
>
>
> When we have wal provider set to multiwal, the ReplicationSource has multiple worker
threads submitting batches to HBaseInterClusterReplicationEndpoint. In such a scenario, it
is quite common to encounter RejectedExecutionException because it takes quite long for shipping
edits to peer cluster compared to reading edits from source and submitting more batches to
the endpoint. 
> The logs are just filled with warnings due to this very exception.
> Since we subdivide batches before actually shipping them, we don't need to fail and resend
the whole batch if one of the sub-batches fails with RejectedExecutionException. Rather, we
should just retry the failed sub-batches. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message