Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6BDA9176B4 for ; Thu, 5 Mar 2015 01:31:43 +0000 (UTC) Received: (qmail 15652 invoked by uid 500); 5 Mar 2015 01:31:30 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 15606 invoked by uid 500); 5 Mar 2015 01:31:30 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15596 invoked by uid 99); 5 Mar 2015 01:31:29 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Mar 2015 01:31:29 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of daemeonr@gmail.com designates 209.85.223.171 as permitted sender) Received: from [209.85.223.171] (HELO mail-ie0-f171.google.com) (209.85.223.171) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Mar 2015 01:31:25 +0000 Received: by iecrp18 with SMTP id rp18so4625433iec.7 for ; Wed, 04 Mar 2015 17:29:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=bFgm8dPoTLfFgcA4VS8DiOqVqibrnRhlDAkgKskXLZE=; b=NTKF1HVz8FelMuTF2zueheVMWpAyyiVLlNEFa8e0u6PoDe2GPCWCLrCIi2dUOHSPfJ lFZfO0uwmzlFgvqGQ2XwdThRtW3uA/OXqH613+X+EqaZDMWiu7trzdXWLlYe6vot4T8+ ohl95Rm52CTJndmyOnXMhbOUKlej//GUMVxXrkCJ5QRHiq0DEIFpA5ZH27F1BpOTnGlB wG2wfgZkGb6YBWjdS8Uzvekh47qNGwLwnzdh3ESbvo4IMlJ1F5Q3g3NTx1HX6LroEf4S r6udbASXQnRjSi6f8l0CJC04yRfoa1TlFWYe2+hg6Ofl5rRlLs0fOvEFttVMN83cKPuk J9zQ== X-Received: by 10.42.202.20 with SMTP id fc20mr798874icb.50.1425518974894; Wed, 04 Mar 2015 17:29:34 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.183.163 with HTTP; Wed, 4 Mar 2015 17:29:04 -0800 (PST) In-Reply-To: References: From: daemeon reiydelle Date: Wed, 4 Mar 2015 17:29:04 -0800 Message-ID: Subject: Re: Does it makes sense to split Gossip from Thrift network To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=20cf301b66a31ec00c0510808029 X-Virus-Checked: Checked by ClamAV on apache.org --20cf301b66a31ec00c0510808029 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable If your cluster is typical, your most critical resource is your network bandwidth, if this is the case, I would not do this split you are proposing. One issue with large MTU's is that they are often split at the switch fabric. Switches are not generally known for having processors that are idle, so this actually slows DOWN throughput to busy nodes. I would also be concerned that in many cases the SAME nodes are supposed to be identifiable as the SAME Gossip and Thrift related node. When you set them up as different IP's I think you will will have additional issues. What is the use case you are trying to solve with this configuration? If Thrift is flooding your network port, then taking away bandwidth (assuming you are bonding?) seems contraproductive. Unless you have not yet tried bonding? *.......* *=E2=80=9CLife should not be a journey to the grave with the intention of a= rriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of smoke,thoroughly used up, totally worn out, and loudly proclaiming =E2=80=9CWow! What a Ride!=E2=80=9D - Hunter ThompsonDaemeon C.= M. ReiydelleUSA (+1) 415.501.0198London (+44) (0) 20 8144 9872* On Wed, Mar 4, 2015 at 4:35 PM, Steffen Winther wrote: > Hi > > Wondering if if makes sense to split network for client traffic vs > Gossip/Internode traffic (possible with larger MTU for storage traffic). > > So I tried this: > > - Gossip storage listener (port 700x) on one network > - Thrift/CQL listeners (port 9160/9042) on another > > Only I find it a bit confusing to control exactly this, > specially when trying to configure OpsCenter and agents. > > Are they any good doc pointers for splitting network? > > TIA > > --20cf301b66a31ec00c0510808029 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
If your cluster is typical, your most = critical resource is your network bandwidth, if this is the case, I would n= ot do this split you are proposing. One issue with large MTU's is that = they are often split at the switch fabric. Switches are not generally known= for having processors that are idle, so this actually slows DOWN throughpu= t to busy nodes.

I would also be concerned= that in many cases the SAME nodes are supposed to be identifiable as the S= AME Gossip and Thrift related node. When you set them up as different IP= 9;s I think you will will have additional issues.

What is the use case you are trying to solve with this configurat= ion? If Thrift is flooding your network port, then taking away bandwidth (a= ssuming you are bonding?) seems contraproductive. Unless you have not yet t= ried bonding?

<= div>
<= span style=3D"color:rgb(56,118,29)"><= /b>
.......
=E2=80=9CLife should not= be a journey to the grave with the intention of arriving safely in a
pretty and well preserved body, but rather to skid in broadside in a cloud of smoke,
thoroughly used up, totally worn out, and loudly proclaiming =E2=80=9CWow! What a Ride!=E2=80=9D

- = Hunter Thompson

Daemeon C.M. Reiydelle
USA (+1) 415.501.0198
L= ondon (+44) (0) 20 8144 9872

On Wed, Mar 4, 2015 at 4:35 PM, Steffen Wint= her <cassandra.user@siimnet.dk> wrote:
Hi

Wondering if if makes sense to split network for client traffic vs
Gossip/Internode traffic (possible with larger MTU for storage traffic).
So I tried this:

- Gossip storage listener (port 700x) on one network
- Thrift/CQL listeners (port 9160/9042) on another

Only I find it a bit confusing to control exactly this,
specially when trying to configure OpsCenter and agents.

Are they any good doc pointers for splitting network?

TIA


--20cf301b66a31ec00c0510808029--