Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of edlinuxguru@gmail.com
 designates 209.85.212.169 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CADrLAEM4_Cr7Z+a0zSqRYO2cWdkPcgfcgTcoFdeoHga7L827SQ@mail.gmail.com>
References: 
 <CADrLAEPXvJx=7jewXB_iwuaKVgkW5P9kfk-e8pqqYpM77pAR2g@mail.gmail.com>
	<CA+VSrLoi6iAfN+H2SyOV6sOJ711qPa-LF41Ys4++SbaCGbtSHg@mail.gmail.com>
	<CADrLAEPQLAfTrMRZY=+pd2TGCt_tsFwx7LHj82KekTByVfR+nA@mail.gmail.com>
	<CADrLAEP14V8M=HFkZ+k3FOct_fVdimqHtQO-9YPms6H-73V8hQ@mail.gmail.com>
	<CADrLAEPPZP=r_8G9XJL=WNfeowAPqekaV3kRvBucrMZoymVFmQ@mail.gmail.com>
	<CADrLAENSiuNDAkzmLSQiqKJYXSkGvwLUhTt=ckDVYFE=FLjm3Q@mail.gmail.com>
	<CADrLAENeJA0GX24eSyoRozq4LZEtD+VA+h=J3ywMgxTk5ORv0A@mail.gmail.com>
	<CAHoS6UZUwTGd-UmR=GBEaoxbZpRYVTrjizkT1wLJ5zUXFiTyPQ@mail.gmail.com>
	<CADrLAEM4_Cr7Z+a0zSqRYO2cWdkPcgfcgTcoFdeoHga7L827SQ@mail.gmail.com>
Date: Mon, 18 Feb 2013 09:44:04 -0500
Message-ID: 
 <CAENxBwzHcVc2fQcwQZuVC2gd_jq8vWEfmcDWJiWf=qknPLTUvg@mail.gmail.com>
Subject: Re: Nodetool doesn't shows two nodes
From: Edward Capriolo <edlinuxguru@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1

These issues are more cloud specific then they are cassandra specific.
Cloud executives tell me in white papers that cloud is awesome and you
can fire all your sysadmins and network people and save money.

This is what happens when you believe cloud executives and their white
papers, you spend 10+ hours troubleshooting cloud networking problems.

On Mon, Feb 18, 2013 at 9:12 AM, Boris Solovyov
<boris.solovyov@gmail.com> wrote:
> I think it is actually more of a problem that there were no error messages
> or other indication of what went wrong in the setup where the nodes couldn't
> contact. Should I file issue report on this? Clearly Cassandra must have
> tried to contact some IP on port 7000 and failed. Why didn't it log? That
> would have saved me about 10 hours :-P
>
>
> On Sun, Feb 17, 2013 at 11:54 PM, Jared Biel <jared.biel@bolderthinking.com>
> wrote:
>>
>> This is something that I found while using the multi-region snitch -
>> it uses public IPs for communication. See the original ticket here:
>> https://issues.apache.org/jira/browse/CASSANDRA-2452. It'd be nice if
>> it used the private IPs to communicate with nodes that are in the same
>> region as itself, but I do not believe this is the case. Be aware that
>> you will be charged for external data transfer even for nodes in the
>> same region because the traffic will not fall under their free (for
>> same AZ) or reduced (for intra-AZ) tiers.
>>
>> If you continue using this snitch in the mean time, it is not
>> necessary (or recommended) to have those ports open to 0.0.0.0/0.
>> You'll simply need to add the public IPs of your C* servers to the
>> correct security group(s) to allow access.
>>
>> There's something else that's a little strange about the EC2 snitches:
>> "us-east-1" is (incorrectly) represented as the datacenter "us-east".
>> Other regions are recognized and named properly (us-west-2 for
>> example) This is kind-of covered in the ticket here:
>> https://issues.apache.org/jira/browse/CASSANDRA-4026 I wish it could
>> be fixed properly.
>>
>> Good luck!
>>
>>
>> On 17 February 2013 16:16, Boris Solovyov <boris.solovyov@gmail.com>
>> wrote:
>> > OK. I got it. I realized that storage_port wasn't actually open between
>> > the
>> > nodes, because it is using the public IP. (I did find this information
>> > in
>> > the docs, after looking more... it is in section on "Types of snitches."
>> > It
>> > explains everything I found by try and error.)
>> >
>> > After opening this port 7000 to all IP addresses, the cluster boots OK
>> > and
>> > the two nodes see each other. Now I have the happy result. But my nodes
>> > are
>> > wide open to the entire internet on port 7000. This is a serious
>> > problem.
>> > This obviously can't be put into production.
>> >
>> > I definitely need cross-continent deployment. Single AZ or single region
>> > deployment is not going to be enough. How do people solve this in
>> > practice?
>
>