Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E713CD793 for ; Wed, 29 Aug 2012 20:33:09 +0000 (UTC) Received: (qmail 45371 invoked by uid 500); 29 Aug 2012 20:33:08 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 45323 invoked by uid 500); 29 Aug 2012 20:33:08 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 45258 invoked by uid 99); 29 Aug 2012 20:33:08 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Aug 2012 20:33:08 +0000 Date: Thu, 30 Aug 2012 07:33:08 +1100 (NCT) From: "Himanshu Vashishtha (JIRA)" To: issues@hbase.apache.org Message-ID: <1288557827.13641.1346272388217.JavaMail.jiratomcat@arcas> Subject: [jira] [Updated] (HBASE-6550) Refactoring ReplicationSink to make it more responsive of cluster health MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Himanshu Vashishtha updated HBASE-6550: --------------------------------------- Attachment: (was: HBase-6165-94-v2.patch) > Refactoring ReplicationSink to make it more responsive of cluster health > ------------------------------------------------------------------------ > > Key: HBASE-6550 > URL: https://issues.apache.org/jira/browse/HBASE-6550 > Project: HBase > Issue Type: New Feature > Components: replication > Reporter: Himanshu Vashishtha > Assignee: Himanshu Vashishtha > Fix For: 0.96.0, 0.94.2 > > Attachments: 6550-havealook.txt, HBase-6550-0.94.patch, HBase-6550-0.94-v2.patch, HBase-6550.patch, HBase-6550-v1.patch, HBase-6550-v3.patch, HBase-6550-v4.patch, HBase-6550-v5.patch > > > ReplicationSink replicates the WALEdits in the local cluster. It uses native HBase client to insert the mutations. Sometime, it takes a while to process it (may be due to region splitting, gc pause, etc) and it undergoes the retrial phase. > It has two repercussions: > a) The regionserver handler which is serving the request (till now, a priority handler) is blocked for this period. > b) The caller may get timed out and it will retry it anyway, but the handler serving the ReplicationSink requests is still working. > Refactoring ReplicationSink to have the following features: > a) Making it more configurable (have its own number of retrial limit, connection timeout, etc) > b) Add a fail fast behavior so that it bails out in case caller is timedout, or any exception in processing the mutation batch. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira