Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 88C7397F5 for ; Thu, 1 Mar 2012 10:09:39 +0000 (UTC) Received: (qmail 71193 invoked by uid 500); 1 Mar 2012 10:09:37 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 71072 invoked by uid 500); 1 Mar 2012 10:09:36 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 71000 invoked by uid 99); 1 Mar 2012 10:09:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Mar 2012 10:09:34 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a91.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Mar 2012 10:09:25 +0000 Received: from homiemail-a91.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a91.g.dreamhost.com (Postfix) with ESMTP id 39566AE059 for ; Thu, 1 Mar 2012 02:09:00 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; q=dns; s=thelastpickle.com; b=Em4GxvWJLA XAg4BP8G8UnUh1hqBg0VG2T+m+q5SvQc+oESVkgKXqi+tUmxXSqVHq1X8gtVluxN NWQ0U8eTJIM3Lg3K9g/w66khCdhuVJVXI84b80DaMALNVntDiWF5v8iZB0NNEfgo U49fyFm46fNddUnYL5Z0/iv5EFeRydu3Q= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; s=thelastpickle.com; bh=wYkRCW8ypT16UulP gQ/2yxPs6+g=; b=nDiyHXNnp0Ytp3a6Gj0iTVx/UnN/E+Fpoes1JnreBrX7UTXB b1oa3uwcyvGwCZtPJcT8//ZtOK5OwmG9TvHQx/TiyiFnf3UG2ZeQ7onbAsFx2TU2 NOEd1GWtfKjW0+HVpTyR3dOFKoW+IqdjbwXwdALrOu4wnrH7ZuFG2q9E2Bo= Received: from [172.16.1.3] (125-236-193-159.adsl.xtra.co.nz [125.236.193.159]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a91.g.dreamhost.com (Postfix) with ESMTPSA id 761DEAE00C for ; Thu, 1 Mar 2012 02:08:59 -0800 (PST) From: aaron morton Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: multipart/alternative; boundary="Apple-Mail=_74B798E7-6C65-4AA1-9988-6F747B82BBF2" Subject: Re: Failed to join ring (NAT) Date: Thu, 1 Mar 2012 23:08:56 +1300 In-Reply-To: To: user@cassandra.apache.org References: Message-Id: X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_74B798E7-6C65-4AA1-9988-6F747B82BBF2 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 > were not immediately picked up=20 They should be re-read on startup.=20 if they were not let us know.=20 Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 29/02/2012, at 10:27 PM, Richard Evans wrote: > Spot on Aaron! >=20 > Of course when I set up the ring the aws nodes could see one another's = internal addresses so I could let the broadcast address default. > I've now used external addresses for all broadcast (and seed) = addresses and it all works fine. >=20 > [[ As a matter of interest, the adjusted values in cassandra.yaml were = not immediately picked up so I zapped the data, which was not a problem = in my case. I assume the conf values are stored in the system schema = somewhere and that this kind of thing could be adjusted more subtly in a = real-world situation. I'll study on but I'm very much liking what I've = seen so far!]] >=20 > Thanks for your help, > Richard >=20 >=20 > From: aaron morton > Reply-To: > Date: Wed, 29 Feb 2012 09:08:16 +1300 > To: > Subject: Re: Failed to join ring (NAT) >=20 > What is the broadcast address on the nodes inside aws ?=20 >=20 > Cheers > ----------------- > Aaron Morton > Freelance Developer > @aaronmorton > http://www.thelastpickle.com >=20 > On 29/02/2012, at 1:41 AM, Richard Evans wrote: >=20 >> I have a small ring of two nodes running successfully on aws.=20 >>=20 >> In order to understand cassandra support for NAT I have tried to add = another node outside aws on a machine behind NAT. >> When I try to join the ring, there is a 30s pause after starting the = messaging service and then it fails, unable to find other nodes. >>=20 >> 12:16:29,834 Starting Messaging Service on port 7000 >> INFO 12:16:29,848 JOINING: waiting for ring and schema information >> INFO 12:16:59,849 JOINING: schema complete, ready to bootstrap >> INFO 12:16:59,850 JOINING: getting bootstrap token >> ERROR 12:16:59,853 Exception encountered during startup >> java.lang.RuntimeException: No other nodes seen! Unable to = bootstrap.If you intended to start a single-node cluster, you should = make sure your broadcast_address (or listen_address) is listed as a = seed. Otherwise, you need to determine why the seed being contacted has = no knowledge of the rest of the cluster. Usually, this can be solved by = giving all nodes the same seed list. >> at = org.apache.cassandra.dht.BootStrapper.getBootstrapSource(BootStrapper.java= :168) >> at = org.apache.cassandra.dht.BootStrapper.getBalancedToken(BootStrapper.java:1= 50) >> =09 >>=20 >> The new node config=20 >> seed_provider: >> - seeds: >>=20 >> listen_address: =20 >> broadcast_address: >>=20 >> The AWS security group config.. >> Admits traffic from on ports 7000, 7001, = 8080 >>=20 >> Netwok paths >> When the new node was attempting to start, I proved the paths between = the seed and the new node. I could =85. >> - telnet from awsNode1 to newNode 7000 >> - telnet from newNode to awsNode1 7000 >>=20 >> Can anyone spot my beginner's mistake?=20 >> Thanks, >> Richard >>=20 >=20 --Apple-Mail=_74B798E7-6C65-4AA1-9988-6F747B82BBF2 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252
http://www.thelastpickle.com

On 29/02/2012, at 10:27 PM, Richard Evans wrote:

Spot on = Aaron!

Of course when I set up the ring the aws = nodes could see one another's internal addresses so I could let the = broadcast address default.
I've now used external addresses = for all broadcast (and seed) addresses and it all works = fine.

[[ As a matter of interest, the adjusted = values in cassandra.yaml were not immediately picked up so I zapped the = data, which was not a problem in my case. I assume the conf values are = stored in the system schema somewhere and that this kind of thing could = be adjusted more subtly in a real-world situation. I'll study on but I'm = very much liking what I've seen so = far!]]

Thanks for your = help,
Richard


From: aaron morton <aaron@thelastpickle.com>Reply-To: <user@cassandra.apache.org>= ;
Date: Wed, 29 Feb 2012 = 09:08:16 +1300
To: <user@cassandra.apache.org>= ;
Subject: Re: Failed to = join ring (NAT)

What is the broadcast address on the nodes inside = aws ? 

Cheers
http://www.thelastpickle.com

On 29/02/2012, at 1:41 AM, Richard Evans wrote:

I = have a small ring of two nodes running successfully on = aws. 

In order to understand cassandra support = for NAT I have tried to add another node outside aws on a machine behind = NAT.
When I try to join the = ring, there is a 30s pause after starting the messaging service and =  then it fails, unable to find other nodes.

 12:16:29,834 Starting Messaging = Service on port 7000
 INFO = 12:16:29,848 JOINING: waiting for ring and schema = information
 INFO 12:16:59,849 JOINING: schema complete, = ready to bootstrap
 INFO 12:16:59,850 JOINING: getting = bootstrap token
ERROR 12:16:59,853 Exception encountered = during startup
java.lang.RuntimeException: No other nodes = seen!  Unable to bootstrap.If you intended to start a single-node = cluster, you should make sure your broadcast_address (or listen_address) = is listed as a seed.  Otherwise, you need to determine why the seed = being contacted has no knowledge of the rest of the cluster. =  Usually, this can be solved by giving all nodes the same seed = list.
= at = org.apache.cassandra.dht.BootStrapper.getBootstrapSource(BootStrapper.java= :168)
= at = org.apache.cassandra.dht.BootStrapper.getBalancedToken(BootStrapper.java:1= 50)

The = new node config 
 - seeds: <awsNode1 external = address>

listen_address: <newNode internal = address> 
broadcast_address: <newNode external = address>

The AWS security group = config..
Admits traffic from <newNode = external address> on ports 7000, 7001, 8080
Netwok paths
When the new node was attempting to = start, I proved the paths between the seed and the new node. I could = =85.
 - telnet from = awsNode1 to newNode 7000
 - telnet from newNode = to awsNode1 7000

Can anyone spot my beginner's mistake? 
Thanks,
Richard