Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4234D17D75 for ; Mon, 9 Feb 2015 07:38:35 +0000 (UTC) Received: (qmail 5755 invoked by uid 500); 9 Feb 2015 07:38:35 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 5701 invoked by uid 500); 9 Feb 2015 07:38:35 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 5689 invoked by uid 99); 9 Feb 2015 07:38:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Feb 2015 07:38:35 +0000 Date: Mon, 9 Feb 2015 07:38:34 +0000 (UTC) From: "hongyu bi (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-3473) Add a configuration property for socket receive buffer size for replication endpoints MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311895#comment-14311895 ] hongyu bi commented on HBASE-3473: ---------------------------------- just revisit replication code, in ReplicationSink#replicateEntries, we can do a quick minor improvement to send batchRPC parallely on table-level. > Add a configuration property for socket receive buffer size for replication endpoints > ------------------------------------------------------------------------------------- > > Key: HBASE-3473 > URL: https://issues.apache.org/jira/browse/HBASE-3473 > Project: HBase > Issue Type: Improvement > Components: Replication > Reporter: Gary Helmling > Priority: Minor > > Looking at this blog post about optimizing replication throughput for LinkedIn's Kafka: > http://sna-projects.com/blog/2011/01/optimizing-tcp-socket-across-data-centers/ > It seems worth testing out if HBase replication connections can also benefit from increasing the socket receive buffer size on (expected to be) high-latency connections. > To this end, we would add a new configuration property for receive buffer size for replication connection and do some benchmarking to evaluate throughput with different values, verifying that making this configurable would have significant impact. For the moment, it seems best to scope the configuration setting to replication connections only, in order to avoid also impacting (negatively) intra-cluster communications. -- This message was sent by Atlassian JIRA (v6.3.4#6332)