Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 95C236D82 for ; Fri, 29 Jul 2011 23:37:44 +0000 (UTC) Received: (qmail 17369 invoked by uid 500); 29 Jul 2011 23:37:41 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 17326 invoked by uid 500); 29 Jul 2011 23:37:41 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 17317 invoked by uid 99); 29 Jul 2011 23:37:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Jul 2011 23:37:40 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.216.172] (HELO mail-qy0-f172.google.com) (209.85.216.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Jul 2011 23:37:33 +0000 Received: by qyk9 with SMTP id 9so118668qyk.10 for ; Fri, 29 Jul 2011 16:37:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.229.27.73 with SMTP id h9mr1374833qcc.278.1311982630210; Fri, 29 Jul 2011 16:37:10 -0700 (PDT) Sender: chris@vsider.com Received: by 10.229.13.10 with HTTP; Fri, 29 Jul 2011 16:37:10 -0700 (PDT) X-Originating-IP: [24.5.105.101] In-Reply-To: References: Date: Fri, 29 Jul 2011 16:37:10 -0700 X-Google-Sender-Auth: 2LXKY5QKG2jIjpLY7sTOKkfo91A Message-ID: Subject: Re: Running across multiple EC2 regions... From: Chris Marino To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001636426a45a00d8204a93dc278 X-Virus-Checked: Checked by ClamAV on apache.org --001636426a45a00d8204a93dc278 Content-Type: text/plain; charset=ISO-8859-1 Thanks Vijay, that helps a lot. FYI, I did read the comments but didn't understand what I was reading since I don't know what IECSC is?? Googled it but still came up empty. What is this?? Sorry, if this is obvious, but I'm pretty new to all this.... Thanks CM On Fri, Jul 29, 2011 at 3:18 PM, Vijay wrote: > "So, my question is: If we use the EC2 Snitch patch to set up across > regions, will the instance's private IP/interface *ever* be used? Or will > all traffic always go in and out of the public interface?? Using the public > interface is slower and more expensive that the private interface. " > > If you use 2452, communication within a region is via private ip and > communication between the regions are public (Handshaking or intial > communication will still be via public ip). In EC2 they dont have 2 > interface but they nat the public IP.... even then this patch will do the > right thing for you. > > There is comments in the patch.... > > + * 1) Snitch will automatically set the public IP by querying the AWS API > + * > + * 2) Snitch will set the private IP as a Gossip application state. > + * > + * 3) Snitch implements IESCS and will reset the connection if it is within the > + * same region to communicate via private IP. > + * > + * Implements Ec2Snitch to inherit its functionality and extend it for > + * Multi-Region. > + * > + * Operational: All the nodes in this cluster needs to be able to (modify the > + * Security group settings in AWS) communicate via Public IP's. > > > Regards, > > > > > > On Fri, Jul 29, 2011 at 2:11 PM, Chris Marino wrote: > >> Hello, >> >> Me and some of my colleagues are about to start some experiments running >> Cassandra across EC2 regions using virtual networks and have some questions >> about how this is going to work. >> >> I've read these threads about patching the .yaml file to bind to the >> Listen address to the public IP... >> >> >> http://mail-archives.apache.org/mod_mbox/cassandra-user/201104.mbox/%3CBANLkTikWGOtWkBOBAs+ibq5voSmjLm=gQQ@mail.gmail. >> com%3E >> >> >> http://mail-archives.apache.org/mod_mbox/cassandra-user/201103.mbox/%3CAANLkTikWsuUOjEU228niWi0iDTAO5J=5wO=i=hG33AnM@mail.gmail.com%3E >> >> And this EC2 Snitch patch that lets it work across regions... >> >> https://issues.apache.org/jira/browse/CASSANDRA-2452 >> >> I'm pretty familiar with EC2 networking, but not very familiar how >> Cassandra will use the RPC and Listen ports with this Snitch. >> >> So, my question is: If we use the EC2 Snitch patch to set up across >> regions, will the instance's private IP/interface *ever* be used? Or will >> all traffic always go in and out of the public interface?? Using the public >> interface is slower and more expensive that the private interface. >> >> What I'm trying to do is set up a virtual network that lets all the nodes >> use private IPs, but can still communicate across regions. >> >> We're going to try this with a virtual network as well as with the EC2 >> Snitch to see how things compare. Being able to use the EC2 private >> interface is going to make big difference. >> >> Thanks in advance. >> CM >> >> > --001636426a45a00d8204a93dc278 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thanks Vijay, that helps a lot.

FYI, =A0I did read the c= omments but didn't understand what I was reading since I don't know= what IECSC is?? Googled it but still came up empty. =A0What is this??
=
Sorry, if this is obvious, but I'm pretty new to all this...= .

Thanks
CM

On Fri, Jul 29, 2011 at 3:18 PM, Vijay <vijay2win@gmail.com&g= t; wrote:
"So, my question is: If we use the EC2 Snitch patch to set up across = regions, will the instance's private IP/interface *ever* be used? Or wi= ll all traffic always go in and out of the public interface?? Using the pub= lic interface is slower and more expensive that the private interface. &quo= t;

If you use 2452, communication within a region is v= ia private ip and communication between the regions are public (Handshaking= or intial communication will still be via public ip). In EC2 they dont hav= e 2 interface but they nat the public IP.... even then this patch will do t= he right thing for you.

There is comments in the patch....
+ * 1) Snitch will automatically set the public IP by querying the AWS API
+ *=20
+ * 2) Snitch will set the private IP as a Gossip application state.
+ *=20
+ * 3) Snitch implements IESCS and will reset the connection if it is withi=
n the
+ * same region to communicate via private IP.
+ *=20
+ * Implements Ec2Snitch to inherit its functionality and extend it for
+ * Multi-Region.
+ *=20
+ * Operational: All the nodes in this cluster needs to be able to (modify =
the
+ * Security group settings in AWS) communicate via Public IP's.
<= /span>

<= /span>Regards,
</VJ>




On Fri, Jul 29, 2011 at 2:11 PM, Chris M= arino <chris@vsider.com> wrote:
Hello,=A0

Me and some of my colleagues are about to star= t some experiments running Cassandra across EC2 regions using virtual netwo= rks and have some=A0questions about how this is going to work.

I've read these threads about patching the .yaml file to bind to t= he Listen address to the public IP...


And this EC2 Snitch patch that lets it work across regions...


I'm pretty familiar with EC2 networking, but not very= familiar=A0how Cassandra will use the RPC and Listen ports with this Snitc= h.

So, my question is: If we use the EC2 Snitch patch to set= up across regions, will the instance's private IP/interface *ever* be = used? Or will all traffic always go in and out of the public interface?? Us= ing the public interface is slower and more expensive that the private inte= rface.=A0

What I'm trying to do is set up a virtual network tha= t lets all the nodes use private IPs, but can still=A0communicate=A0across = regions.=A0

We're going to try this with a virtual network as wel= l as with the EC2 Snitch to see how things compare. Being able to use the E= C2 private interface is going to make big difference.

Thanks in advance.
CM



--001636426a45a00d8204a93dc278--