Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7F7C8408B for ; Wed, 25 May 2011 06:50:38 +0000 (UTC) Received: (qmail 68711 invoked by uid 500); 25 May 2011 06:50:36 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 68661 invoked by uid 500); 25 May 2011 06:50:35 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 68653 invoked by uid 99); 25 May 2011 06:50:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 May 2011 06:50:35 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of marcus@synchromedia.co.uk designates 83.170.116.207 as permitted sender) Received: from [83.170.116.207] (HELO mail.synchromedia.co.uk) (83.170.116.207) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 May 2011 06:50:29 +0000 Received: from [192.168.1.10] (146.146.204.77.rev.sfr.net [77.204.146.146]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.synchromedia.co.uk (Postfix) with ESMTPSA id 9BBE772329 for ; Wed, 25 May 2011 07:50:07 +0100 (BST) From: Marcus Bointon Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: multipart/alternative; boundary=Apple-Mail-150--565990601 Subject: Re: EC2 node adding trouble Date: Wed, 25 May 2011 08:50:07 +0200 In-Reply-To: To: user@cassandra.apache.org References: <6AF0D2D6-EB8B-47BC-800C-F9AD87B21E0B@synchromedia.co.uk> Message-Id: <0188B94A-F8E0-47C3-8470-904576C09659@synchromedia.co.uk> X-Mailer: Apple Mail (2.1084) --Apple-Mail-150--565990601 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 24 May 2011, at 23:58, Sameer Farooqui wrote: > Even with AutoBootstrap it is recommended that you always specify the = InitialToken on the new node because the picking of an initial token = will almost certainly result in an unbalanced ring. >=20 > Right now, I'm afraid that if you simply copied the YAML file from one = of the two nodes to the 3rd node, then the 3rd node has an incorrect = initial_token setting (it may be conflicting with node 1 or 2's range).=20= >=20 > Some info about how to choose tokens: > http://wiki.apache.org/cassandra/Operations#Token_selection > = http://journal.paul.querna.org/articles/2010/09/24/cassandra-token-selecti= on/ >=20 > So, once you know what token each of the 3 nodes should have, shut = down the first two nodes, change their tokens and add the correct token = to the 3rd node (in the YAML file). At the moment I'm not bothered about balance - just having it work at = all would be good! initial_token is currently blank (i.e. self-defining = according to the docs) on all nodes - I can see why that might cause = balance issues, but I don't see that it would prevent it working as = there should not be a token clash. If there was a token clash, wouldn't = it throw an error saying so? That second article, while wonderfully practical and informative, = suggests that cassandra is really not suited to rapid scaling up or down = - i.e. adding or removing nodes is neither quick nor painless, e.g. = scaling from 5 to 20 nodes and back is something that might happen over = weeks rather than minutes. Maybe cassandra just isn't the right tool for = the job in this case? Marcus= --Apple-Mail-150--565990601 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii
Even = with AutoBootstrap it is recommended that you always specify = the InitialToken on the new node because the picking of an initial = token will almost certainly result in an unbalanced = ring.

Right now, I'm afraid that if you simply copied = the YAML file from one of the two nodes to the 3rd node, then the 3rd = node has an incorrect initial_token setting (it may be conflicting with = node 1 or 2's range). 

Some info about how = to choose tokens:
<= a = href=3D"http://journal.paul.querna.org/articles/2010/09/24/cassandra-token= -selection/">http://journal.paul.querna.org/articles/2010/09/24/cassandra-= token-selection/

So, once you know what token = each of the 3 nodes should have, shut down the first two nodes, change = their tokens and add the correct token to the 3rd node (in the YAML = file).

At the moment I'm = not bothered about balance - just having it work at all would be good! = initial_token is currently blank (i.e. self-defining according to the = docs) on all nodes - I can see why that might cause balance issues, but = I don't see that it would prevent it working as there should not be a = token clash. If there was a token clash, wouldn't it throw an error = saying so?

That second article, while = wonderfully practical and informative, suggests that cassandra is really = not suited to rapid scaling up or down - i.e. adding or removing nodes = is neither quick nor painless, e.g. scaling from 5 to 20 nodes and back = is something that might happen over weeks rather than minutes. Maybe = cassandra just isn't the right tool for the job in this = case?

Marcus
= --Apple-Mail-150--565990601--