From user-return-31664-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Tue Feb 5 19:41:25 2013 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 81C08E478 for ; Tue, 5 Feb 2013 19:41:25 +0000 (UTC) Received: (qmail 45621 invoked by uid 500); 5 Feb 2013 19:41:22 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 45574 invoked by uid 500); 5 Feb 2013 19:41:22 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 45564 invoked by uid 99); 5 Feb 2013 19:41:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Feb 2013 19:41:22 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of Stephen.M.Thompson@wellsfargo.com designates 151.151.26.137 as permitted sender) Received: from [151.151.26.137] (HELO mxdcmv01i.wellsfargo.com) (151.151.26.137) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Feb 2013 19:41:15 +0000 Received: from mxicmx02.wellsfargo.com (mxicmx02.wellsfargo.com [162.102.137.63]) by mxdcmv01i.wellsfargo.com (Sentrion-MTA-4.2.2/Sentrion-MTA-4.2.2) with ESMTP id r15Jer3T019693 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Tue, 5 Feb 2013 19:40:54 GMT DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wellsfargo.com; s=2011-05-wfb; t=1360093254; bh=RlfFFO+rjp9DBecmPMSUh2qHp23Ok4qEQiNOykTpEvQ=; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; b=Kh+GipYUGmCb/ofLofMbS6d1lNoB215Oe+LXqHt1ckUiHjOC47mmpin4VXn4j3Asa h/DbvYXhihJ7KULm2xnC/bAwq6Xu5QypkF78rjMrX31++DrHnHTfKk1H9P48b1zGeV /ij6DfR2nCQEaKu6rXeiERBypiz7vrJoHPgYtbdU= Received: from msgexsil4005.ent.wfb.bank.corp (msgexsil4005.wellsfargo.com [170.13.178.15]) by mxicmx02.wellsfargo.com (Sentrion-MTA-4.2.2/Sentrion-MTA-4.2.2) with ESMTP id r15JeQRY007040 for ; Tue, 5 Feb 2013 19:40:53 GMT Received: from MSGCMSIL1003.ent.wfb.bank.corp ([169.254.1.147]) by msgexsil4005.ent.wfb.bank.corp ([170.13.178.15]) with mapi; Tue, 5 Feb 2013 14:40:42 -0500 From: To: Date: Tue, 5 Feb 2013 14:40:42 -0500 Subject: unbalanced ring Thread-Topic: unbalanced ring Thread-Index: Ac4DzED0T+tc20YYSsqmAhOAKL+enA== Message-ID: <333B362E7B77B344A2D0FD92840282611F81E988B8@MSGCMSIL1003.ent.wfb.bank.corp> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_333B362E7B77B344A2D0FD92840282611F81E988B8MSGCMSIL1003e_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_333B362E7B77B344A2D0FD92840282611F81E988B8MSGCMSIL1003e_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable So I have three nodes in a ring in one data center. My configuration has n= um_tokens: 256 set and initial_token commented out. When I look at the rin= g, it shows me all of the token ranges of course, and basically identical d= ata for each range on each node. Here is the Cliff's Notes version of what= I see: [root@Config3482VM2 apache-cassandra-1.2.0]# bin/nodetool ring Datacenter: 28 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Replicas: 1 Address Rack Status State Load Owns = Token = 9187343239835811839 10.28.205.125 205 Up Normal 2.85 GB 33.69% = -3026347817059713363 10.28.205.125 205 Up Normal 2.85 GB 33.69% = -3026276684526453414 10.28.205.125 205 Up Normal 2.85 GB 33.69% = -3026205551993193465 (etc) 10.28.205.126 205 Up Normal 1.15 GB 100.00% = -9187343239835811840 10.28.205.126 205 Up Normal 1.15 GB 100.00% = -9151314442816847872 10.28.205.126 205 Up Normal 1.15 GB 100.00% = -9115285645797883904 (etc) 10.28.205.127 205 Up Normal 69.13 KB 66.30% = -9223372036854775808 10.28.205.127 205 Up Normal 69.13 KB 66.30% = 36028797018963967 10.28.205.127 205 Up Normal 69.13 KB 66.30% = 72057594037927935 (etc) So at this point I have a number of questions. The biggest question is of= Load. Why does the .125 node have 2.85 GB, .126 has 1.15 GB, and .127 has= only 0.000069 GB? These boxes are all comparable and all configured ident= ically. partitioner: org.apache.cassandra.dht.Murmur3Partitioner I'm sorry to ask so many questions - I'm having a hard time finding documen= tation that explains this stuff. Stephen --_000_333B362E7B77B344A2D0FD92840282611F81E988B8MSGCMSIL1003e_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

So I have three nodes in a ring in one d= ata center.  My configuration has num_tokens: 256 set and initial_token commented out.  When I look at the ring, it shows me all of the t= oken ranges of course, and basically identical data for each range on each = node.  Here is the Cliff’s Notes version of what I see:

 

[root@Config3482VM2 apache-cassan= dra-1.2.0]# bin/nodetool ring

 

Datacenter: 28

=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D

Replicas: 1

 

Address      &nb= sp;  Rack        Status State =   Load           &nb= sp;Owns           &n= bsp;    Token

   &nb= sp;            =             &nb= sp;            =             &nb= sp;            =              91= 87343239835811839

10.28.205.125   205&nb= sp;        Up     No= rmal  2.85 GB         33.69%&n= bsp;            = ; -3026347817059713363

10.28.205.125   2= 05         Up   &nbs= p; Normal  2.85 GB         33.= 69%            =   -3026276684526453414

10.28.205.125 &nb= sp; 205         Up   = ;  Normal  2.85 GB        = ; 33.69%           &= nbsp;  -3026205551993193465

=   (etc)=

10.28.205.126   205    &= nbsp;    Up     Normal  1.15 GB&nbs= p;        100.00%    = ;         -9187343239835811840=

10.28.205.126   205    &= nbsp;    Up     Normal  1.15 GB&nbs= p;        100.00%    = ;         -9151314442816847872=

10.28.205.126   205    &= nbsp;    Up     Normal  1.15 GB&nbs= p;        100.00%    = ;         -9115285645797883904=

  (etc)

10.28.205.127&nb= sp;  205         Up  = ;   Normal  69.13 KB      &nbs= p; 66.30%           =    -9223372036854775808

10.28.205.127&nb= sp;  205         Up  = ;   Normal  69.13 KB      &nbs= p; 66.30%           =    36028797018963967

10.28.205.127 =  205         Up  &n= bsp;  Normal  69.13 KB        = 66.30%           &nb= sp;  72057594037927935

  (etc)

 

So at this point I have a number = of questions.   The biggest question is of Load.  Why does t= he .125 node have 2.85 GB, .126 has 1.15 GB, and .127 has only 0.000069 GB?=   These boxes are all comparable and all configured identically.<= /o:p>

 

partitioner: org.apache.cassandra.dht.Murmur= 3Partitioner

 

I’m sorry to = ask so many questions – I’m having a hard time finding document= ation that explains this stuff.

<= span style=3D'font-family:"Candara","sans-serif"'> <= /p>

= Stephen

= --_000_333B362E7B77B344A2D0FD92840282611F81E988B8MSGCMSIL1003e_--