From user-return-24542-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Mon Mar 5 10:49:14 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8B25A9FFE for ; Mon, 5 Mar 2012 10:49:14 +0000 (UTC) Received: (qmail 59377 invoked by uid 500); 5 Mar 2012 10:49:12 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59354 invoked by uid 500); 5 Mar 2012 10:49:12 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59346 invoked by uid 99); 5 Mar 2012 10:49:12 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Mar 2012 10:49:12 +0000 X-ASF-Spam-Status: No, hits=3.3 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS,TRACKER_ID X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a92.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 05 Mar 2012 10:49:07 +0000 Received: from homiemail-a92.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a92.g.dreamhost.com (Postfix) with ESMTP id 00E953DC065 for ; Mon, 5 Mar 2012 02:48:44 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; q=dns; s=thelastpickle.com; b=ljmDkwPWVR Xo1dzR8J1PXY0gKFBUqYVNAtG6mpM48rKCuNzLNZiw06Kl+h9ttu/FiY5e6SjWOc p2C+ScpdQvqHp+jLLE5wFf31oNpicFowI4wVpzLWhh6x97y40Jh2v24YFgRmu+vT Bc3jpWNjfoVI5dF59l48oyTisVxzfFPpE= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :mime-version:content-type:subject:date:in-reply-to:to :references:message-id; s=thelastpickle.com; bh=Hp7CU6z/eK23NbmR 9ixth45h6yg=; b=JEtCiSD+r0CRk3KsYZl4idrckKOIFXd0wna9vQrAdbuP5sDm 40KoOEPJV+0etGSGpnYtC6+KzqTjSsc1u69/3FQfKsHQfeWOCyWmrE0XetfPHwaj lEh0BYE+7kW0nA5Hm5juRjXRFtKmouynU9QCUlw2DHfo3TcPpsH9k5SNxyo= Received: from [172.16.1.3] (125-236-193-159.adsl.xtra.co.nz [125.236.193.159]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a92.g.dreamhost.com (Postfix) with ESMTPSA id 9346C3DC05B for ; Mon, 5 Mar 2012 02:48:41 -0800 (PST) From: aaron morton Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: multipart/alternative; boundary="Apple-Mail=_E137F224-5182-4E8D-A3E2-0D6FC599A7C0" Subject: Re: running two rings on the same subnet Date: Mon, 5 Mar 2012 23:48:37 +1300 In-Reply-To: <4F5497BE.5090001@flyordie.com> To: user@cassandra.apache.org References: <4F5497BE.5090001@flyordie.com> Message-Id: <2D29EBE9-C4BA-40DF-8C38-5ED93B5EAA4E@thelastpickle.com> X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_E137F224-5182-4E8D-A3E2-0D6FC599A7C0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=iso-8859-1 Do you want to create two separate clusters or a single cluster with two = data centres ?=20 If it's the later, token selection is discussed here = http://www.datastax.com/docs/1.0/install/cluster_init#token-gen-cassandra =20 > Moreover all tokens must be unique (even across datacenters), although = - from pure curiosity - I wonder what is the rationale behind this. Otherwise data is not evenly distributed. > By the way, can someone enlighten me about the first line in the = output of the nodetool. Obviously it contains a token, but nothing else. = It seems like a formatting glitch, but maybe it has a role.=20 It's the exclusive lower bound token for the first node in the ring. = This also happens to be the token for the last node in the ring.=20 In your setup=20 10.0.0.19 "owns" (85070591730234615865843651857942052864+1) to 0 10.0.0.28 "owns" (0 + 1) to 85070591730234615865843651857942052864 (does not imply primary replica, just used to map keys to nodes.) =20 ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/03/2012, at 11:38 PM, Hontv=E1ri J=F3zsef Levente wrote: > You have to use PropertyFileSnitch and NetworkTopologyStrategy to = create a multi-datacenter setup with two circles. You can start reading = from this page: > = http://www.datastax.com/docs/1.0/cluster_architecture/replication#about-re= plica-placement-strategy >=20 > Moreover all tokens must be unique (even across datacenters), although = - from pure curiosity - I wonder what is the rationale behind this. >=20 > By the way, can someone enlighten me about the first line in the = output of the nodetool. Obviously it contains a token, but nothing else. = It seems like a formatting glitch, but maybe it has a role.=20 >=20 > On 2012.03.05. 11:06, Tamar Fraenkel wrote: >>=20 >> Hi! >> I have a Cassandra cluster with two nodes >>=20 >> nodetool ring -h localhost >> Address DC Rack Status State Load = Owns Token >> = 85070591730234615865843651857942052864 >> 10.0.0.19 datacenter1 rack1 Up Normal 488.74 KB = 50.00% 0 >> 10.0.0.28 datacenter1 rack1 Up Normal 504.63 KB = 50.00% 85070591730234615865843651857942052864 >>=20 >> I want to create a second ring with the same name but two different = nodes. >> using tokengentool I get the same tokens as they are affected from = the number of nodes in a ring. >>=20 >> My question is like this: >> Lets say I create two new VMs, with IPs: 10.0.0.31 and 10.0.0.11 >> In 10.0.0.31 cassandra.yaml I will set >> initial_token: 0 >> seeds: "10.0.0.31" >> listen_address: 10.0.0.31 >> rpc_address: 0.0.0.0 >>=20 >> In 10.0.0.11 cassandra.yaml I will set >> initial_token: 85070591730234615865843651857942052864 >> seeds: "10.0.0.31" >> listen_address: 10.0.0.11 >> rpc_address: 0.0.0.0=20 >>=20 >> Would the rings be separate? >>=20 >> Thanks, >>=20 >> Tamar Fraenkel=20 >> Senior Software Engineer, TOK Media=20 >>=20 >> >>=20 >> tamar@tok-media.com >> Tel: +972 2 6409736=20 >> Mob: +972 54 8356490=20 >> Fax: +972 2 5612956=20 >>=20 >>=20 >>=20 >=20 --Apple-Mail=_E137F224-5182-4E8D-A3E2-0D6FC599A7C0 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=iso-8859-1 Do = you want to create two separate clusters or a single cluster with two = data centres ? 

If it's the later, token = selection is discussed here http://www.datastax.com/docs/1.0/install/cluster_init#token-gen-c= assandra
 
Moreover all tokens must be unique = (even across datacenters), although - from pure curiosity - I wonder = what is the rationale behind this.
Otherwise data = is not evenly distributed.

By the way, can = someone enlighten me about the first line in the output of the nodetool. = Obviously it contains a token, but nothing else. It seems like a = formatting glitch, but maybe it has a = role. 
It's the exclusive lower bound token = for the first node in the ring. This also happens to be the token for = the last node in the ring. 

In your = setup 
10.0.0.19 "owns" (10.0.0.28 = "owns"  (0 + 1) to 
http://www.thelastpickle.com

On 5/03/2012, at 11:38 PM, Hontv=E1ri J=F3zsef Levente = wrote:

=20 =20
You have to use PropertyFileSnitch and NetworkTopologyStrategy to create a multi-datacenter setup with two circles. You can start reading from this page:
http://www.datastax.com/docs/1.0/cluster= _architecture/replication#about-replica-placement-strategy

Moreover all tokens must be unique (even across datacenters), although - from pure curiosity - I wonder what is the rationale behind this.

By the way, can someone enlighten me about the first line in the output of the nodetool. Obviously it contains a token, but nothing else. It seems like a formatting glitch, but maybe it has a role. =

On 2012.03.05. 11:06, Tamar Fraenkel wrote:
Hi!
I have a Cassandra  cluster with two nodes

nodetool ring -h = localhost
Address       =   DC          Rack        Status State   Load     =        Owns    Token
        =                     =                         =                     =        85070591730234615865843651857942052864
10.0.0.19       = datacenter1 rack1       Up     Normal  488.74 KB =       50.00%  0
10.0.0.28       = datacenter1 rack1       Up     Normal  504.63 KB =       50.00%  85070591730234615865843651857942052864

I want to create a second ring with the same name but two different nodes.
using tokengentool I get the same tokens as they are affected from the number of nodes in a ring.

My question is like this:
Lets say I create two new VMs, with IPs: 10.0.0.31 and 10.0.0.11
In 10.0.0.31 cassandra.yaml I will set
initial_token: 0
seeds: "10.0.0.31"
listen_address: 10.0.0.31
rpc_address: 0.0.0.0

In 10.0.0.11 cassandra.yaml I will = set
=
initial_token: 85070591730234615865843651857942052864
seeds: "10.0.0.31"
listen_address: 10.0.0.11
rpc_address: 0.0.0.0 

Would the rings be separate?

Thanks,

Tamar Fraenkel 
Senior Software Engineer, TOK Media 

<Mail = Attachment.png>





= --Apple-Mail=_E137F224-5182-4E8D-A3E2-0D6FC599A7C0--