From user-return-31668-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Tue Feb 5 20:41:36 2013 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C074CD772 for ; Tue, 5 Feb 2013 20:41:36 +0000 (UTC) Received: (qmail 51551 invoked by uid 500); 5 Feb 2013 20:41:34 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 51487 invoked by uid 500); 5 Feb 2013 20:41:34 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 51478 invoked by uid 99); 5 Feb 2013 20:41:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Feb 2013 20:41:34 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a51.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Feb 2013 20:41:27 +0000 Received: from homiemail-a51.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a51.g.dreamhost.com (Postfix) with ESMTP id B7DEE2E8079 for ; Tue, 5 Feb 2013 12:41:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :content-type:message-id:mime-version:subject:date:references:to :in-reply-to; s=thelastpickle.com; bh=EZDtSJLBpB3H5yBRxzSmWgpOBV I=; b=gikWoCd9Fjz0kxC6yPVWCXN+CTyuzZjCeyEUq4BigP8NRiwoOp8PaK/DMc MbNYWHy3Ow3+MGfTMGz4jsx9ey4OfsVMSUw21p+1SMNonP73opGY0sgQHEumDXw1 pINoeNfK6HrYDc/jro3alBPyMT3kxMGv3/koGhBol7nxsCOL4= Received: from [172.16.1.8] (unknown [203.86.207.101]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a51.g.dreamhost.com (Postfix) with ESMTPSA id 062762E805C for ; Tue, 5 Feb 2013 12:41:04 -0800 (PST) From: aaron morton Content-Type: multipart/alternative; boundary="Apple-Mail=_AE172A13-2D43-4953-ADBA-C06A8B89A531" Message-Id: <93D300EB-D605-4FFA-9F65-BF9428CF94B2@thelastpickle.com> Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: unbalanced ring Date: Wed, 6 Feb 2013 09:41:05 +1300 References: <333B362E7B77B344A2D0FD92840282611F81E988B8@MSGCMSIL1003.ent.wfb.bank.corp> To: user@cassandra.apache.org In-Reply-To: <333B362E7B77B344A2D0FD92840282611F81E988B8@MSGCMSIL1003.ent.wfb.bank.corp> X-Mailer: Apple Mail (2.1499) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_AE172A13-2D43-4953-ADBA-C06A8B89A531 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Use nodetool status with vnodes = http://www.datastax.com/dev/blog/upgrading-an-existing-cluster-to-vnodes The different load can be caused by rack affinity, are all the nodes in = the same rack ? Another simple check is have you created some very big = rows? Cheers ----------------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/02/2013, at 8:40 AM, Stephen.M.Thompson@wellsfargo.com wrote: > So I have three nodes in a ring in one data center. My configuration = has num_tokens: 256 set andinitial_token commented out. When I look at = the ring, it shows me all of the token ranges of course, and basically = identical data for each range on each node. Here is the Cliff=92s Notes = version of what I see: > =20 > [root@Config3482VM2 apache-cassandra-1.2.0]# bin/nodetool ring > =20 > Datacenter: 28 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > Replicas: 1 > =20 > Address Rack Status State Load Owns = Token > = 9187343239835811839 > 10.28.205.125 205 Up Normal 2.85 GB 33.69% = -3026347817059713363 > 10.28.205.125 205 Up Normal 2.85 GB 33.69% = -3026276684526453414 > 10.28.205.125 205 Up Normal 2.85 GB 33.69% = -3026205551993193465 > (etc) > 10.28.205.126 205 Up Normal 1.15 GB 100.00% = -9187343239835811840 > 10.28.205.126 205 Up Normal 1.15 GB 100.00% = -9151314442816847872 > 10.28.205.126 205 Up Normal 1.15 GB 100.00% = -9115285645797883904 > (etc) > 10.28.205.127 205 Up Normal 69.13 KB 66.30% = -9223372036854775808 > 10.28.205.127 205 Up Normal 69.13 KB 66.30% = 36028797018963967 > 10.28.205.127 205 Up Normal 69.13 KB 66.30% = 72057594037927935 > (etc) > =20 > So at this point I have a number of questions. The biggest question = is of Load. Why does the .125 node have 2.85 GB, .126 has 1.15 GB, and = .127 has only 0.000069 GB? These boxes are all comparable and all = configured identically. > =20 > partitioner: org.apache.cassandra.dht.Murmur3Partitioner > =20 > I=92m sorry to ask so many questions =96 I=92m having a hard time = finding documentation that explains this stuff. > =20 > Stephen --Apple-Mail=_AE172A13-2D43-4953-ADBA-C06A8B89A531 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 Use nodetool status with = vnodes http://www.datastax.com/dev/blog/upgrading-an-existing-cluster-to-= vnodes

The different load can be caused by rack = affinity, are all the nodes in the same rack ? Another simple check is = have you created some very big rows?
Cheers

http://www.thelastpickle.com

On 6/02/2013, at 8:40 AM, Stephen.M.Thompson@wells= fargo.com wrote:

 num_tokens: 256 set andinitial_token commented out.  When I = look at the ring, it shows me all of the token ranges of course, and = basically identical data for each range on each node.  Here is the = Cliff=92s Notes version of what I see:
[root@Config3482VM2 = apache-cassandra-1.2.0]# bin/nodetool ring
 
Datacenter: = 28
Replicas: 1
10.28.205.125   = 205      =    Up     Normal  2.85 = GB         = 33.69%           &n= bsp;  -3026276684526453414
10.28.205.125   = 205         = Up     Normal  2.85 = GB         = 33.69%           &n= bsp;  -3026205551993193465
  (etc)
  = (etc)
10.28.205.127   = 205         = Up     Normal  69.13 = KB        = 66.30%           &n= bsp;  36028797018963967
  = (etc)
So at this point I have a number of = questions.   The biggest question is of Load.  Why does = the .125 node have 2.85 GB, .126 has 1.15 GB, and .127 has only 0.000069 = GB?  These boxes are all comparable and all configured = identically.
 
I=92m sorry to ask so many questions =96 I=92m = having a hard time finding documentation that explains this = stuff.