hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gary Helmling (JIRA)" <j...@apache.org>
Subject [jira] Created: (HBASE-3473) Add a configuration property for socket receive buffer size for replication endpoints
Date Mon, 24 Jan 2011 22:05:45 GMT
Add a configuration property for socket receive buffer size for replication endpoints
-------------------------------------------------------------------------------------

                 Key: HBASE-3473
                 URL: https://issues.apache.org/jira/browse/HBASE-3473
             Project: HBase
          Issue Type: Improvement
          Components: replication
            Reporter: Gary Helmling
            Priority: Minor


Looking at this blog post about optimizing replication throughput for LinkedIn's Kafka:
http://sna-projects.com/blog/2011/01/optimizing-tcp-socket-across-data-centers/

It seems worth testing out if HBase replication connections can also benefit from increasing
the socket receive buffer size on (expected to be) high-latency connections.

To this end, we would add a new configuration property for receive buffer size for replication
connection and do some benchmarking to evaluate throughput with different values, verifying
that making this configurable would have significant impact. For the moment, it seems best
to scope the configuration setting to replication connections only, in order to avoid also
impacting (negatively) intra-cluster communications.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message