Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Tue, 5 Jul 2016 21:15:11 +0000 (UTC)
From: "Thom Valley (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12984455.1467139319000.30293.1467753311352@Atlassian.JIRA>
In-Reply-To: <JIRA.12984455.1467139319000@Atlassian.JIRA>
References: <JIRA.12984455.1467139319000@Atlassian.JIRA> <JIRA.12984455.1467139319607@arcas>
Subject: [jira] [Commented] (CASSANDRA-12104) Handle coalesce efforts for
 inter-dc traffic discretely from intra-dc traffic
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 05 Jul 2016 21:15:13 -0000


    [ https://issues.apache.org/jira/browse/CASSANDRA-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363265#comment-15363265 ] 

Thom Valley commented on CASSANDRA-12104:
-----------------------------------------

Ariel,

Something to consider in that is both what Jeremiah stated above, but also the fact that DC location can heavily impact both available bandwidth and latency.  

In the example I have, there are two DCs in the US, relatively close to each other (30ms apart) with almost 10G bandwidth between them, but the remote DCs vary from 70ms up to over 200 ms with substantially less bandwidth available.

The ideal scenario for most inter-dc throttles would be to control it by connection (by that I mean each distinct inter-dc path).  But perhaps that is too complicated.

I will get the details from the customer on exactly what levels showed the benefits based on which DC we were evaluating.


> Handle coalesce efforts for inter-dc traffic discretely from intra-dc traffic
> -----------------------------------------------------------------------------
>
>                 Key: CASSANDRA-12104
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-12104
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Thom Valley
>            Priority: Minor
>
> In relationship to CASSANDRA-8692, we have discovered that pushing coalescing windows to the point where they have a positive impact on inter-dc traffic overhead appears to have causes delays in intra-dc traffic (namely, quorum requests between nodes).  Having the same coalescing strategy apply to all messages (especially intra-dc request/response messages) seems like a bad idea.
> This was in a 5 DC environment with from 30 to 130 ms of latency between the DCs.  Local network was entirely unrestricted 10G ethernet.
> Being able to apply different coalescing rules to those two classifications of traffic would allow much more effective tuning of the coalescing strategies, save inter-dc bandwidth while not having any impact on intra-dc message handling.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)