Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 99879 invoked from network); 14 Mar 2011 22:59:27 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 14 Mar 2011 22:59:27 -0000 Received: (qmail 37672 invoked by uid 500); 14 Mar 2011 22:59:25 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 37645 invoked by uid 500); 14 Mar 2011 22:59:25 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 37635 invoked by uid 99); 14 Mar 2011 22:59:25 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Mar 2011 22:59:25 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sdolgy@gmail.com designates 209.85.216.172 as permitted sender) Received: from [209.85.216.172] (HELO mail-qy0-f172.google.com) (209.85.216.172) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Mar 2011 22:59:20 +0000 Received: by qyk29 with SMTP id 29so1757734qyk.10 for ; Mon, 14 Mar 2011 15:58:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=AtVWduZRljOxivbMxYyuK0S7FygcI9MWJ7sfBlcmKyQ=; b=Gwx4qlxhTkX8736/vOS1vx/Puh4hh1jAlOvBACnKCHb3TP3rfUKbst7u5ZzdWHnySF 4jywkEBKnUp5YdRYFM79DccEicMvNfarMmLvwGK5Y1Y+M0y6cKbOAVGNXXtR3pTe2kss 5LQmWOXZpKHmxcl8T4qtlhEVcjDF2pLd7fr5w= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=kBsVjF8an+WYGmeer22AVk0qOf97uwHyafLzX+m2EjhVDoCqek9r//tjQaLR8OpGXA ro9qQSVm3pWnUFFJtLpO82ekXmJnbUhGHfkhEwnyTkXapKWZNm3jbafbxy675bV+2nvr v1dcCrzw92MNqP7lG+Q4h57S1N+V4pryC5YgM= MIME-Version: 1.0 Received: by 10.229.78.224 with SMTP id m32mr10676272qck.11.1300143539110; Mon, 14 Mar 2011 15:58:59 -0700 (PDT) Received: by 10.229.183.195 with HTTP; Mon, 14 Mar 2011 15:58:58 -0700 (PDT) Received: by 10.229.183.195 with HTTP; Mon, 14 Mar 2011 15:58:58 -0700 (PDT) In-Reply-To: References: Date: Mon, 14 Mar 2011 23:58:58 +0100 Message-ID: Subject: Re: nodetool loadbalance From: Sasha Dolgy To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=00235446fe4cce4448049e7941b1 --00235446fe4cce4448049e7941b1 Content-Type: text/plain; charset=ISO-8859-1 Yes, a lot of what is on the wiki makes perfect sense when read the right way. suppose there arent enough pictures or before/after info online to help the knowledge flow. On Mar 14, 2011 11:52 PM, "Jonathan Ellis" wrote: > You should read http://wiki.apache.org/cassandra/Operations before > running loadbalance. > > On Mon, Mar 14, 2011 at 5:27 PM, Sasha Dolgy wrote: >> With my six node cluster ... nodetool loadbalance should be run on one >> node or all six? I run it on one and the ownership percentage gets >> even more unbalanced. So... in the spirit of the evening, I run it on >> another node ..... as you see, the ownership % keeps increasing and >> the token numbers keep increasing. is this expected? I would have >> hoped that the behaviour would be a little bit different. Maybe I've >> missed something big.... >> >> >> >> Address Status State Load Owns Token >> >> 124804735337540159479107746638263794797 >> 10.0.0.1 Up Normal 225 KB 40.78% >> 24053088190195663439419935163232881936 >> 10.0.0.2 Up Normal 201.21 KB 19.17% >> 56667357399723182105247119364967854254 >> 10.0.0.3 Up Normal 213.15 KB 17.61% >> 86624712919272143003828971968762407027 >> 10.0.0.4 Up Normal 214.54 KB 11.22% >> 105714724128406151241468359303513100912 >> 10.0.0.5 Up Normal 206.39 KB 5.61% >> 115259729732973155360288052970888447854 >> 10.0.0.6 Up Normal 242.93 KB 5.61% >> 124804735337540159479107746638263794797 >> >> >> Address Status State Load Owns Token >> >> 124804735337540159479107746638263794797 >> 10.0.0.2 Up Normal 206.15 KB 59.95% >> 56667357399723182105247119364967854254 >> 10.0.0.3 Up Normal 218.1 KB 17.61% >> 86624712919272143003828971968762407027 >> 10.0.0.4 Up Normal 219.48 KB 11.22% >> 105714724128406151241468359303513100912 >> 10.0.0.5 Up Normal 216.31 KB 5.61% >> 115259729732973155360288052970888447854 >> 10.0.0.1 Up Normal 224.32 KB 2.81% >> 120032232535256657419697899804576121325 >> 10.0.0.6 Up Normal 242.93 KB 2.81% >> 124804735337540159479107746638263794797 >> >> >> Address Status State Load Owns Token >> >> 124804735337540159479107746638263794797 >> 10.0.0.3 Up Normal 218.1 KB 77.56% >> 86624712919272143003828971968762407027 >> 10.0.0.4 Up Normal 225.71 KB 11.22% >> 105714724128406151241468359303513100912 >> 10.0.0.5 Up Normal 216.31 KB 5.61% >> 115259729732973155360288052970888447854 >> 10.0.0.1 Up Normal 224.32 KB 2.81% >> 120032232535256657419697899804576121325 >> 10.0.0.2 Up Normal 201.21 KB 1.40% >> 122418483936398408449402823221419958061 >> 10.0.0.6 Up Normal 242.93 KB 1.40% >> 124804735337540159479107746638263794797 >> >> Address Status State Load Owns Token >> >> 124804735337540159479107746638263794797 >> 10.0.0.4 Up Normal 225.71 KB 88.78% >> 105714724128406151241468359303513100912 >> 10.0.0.5 Up Normal 225.61 KB 5.61% >> 115259729732973155360288052970888447854 >> 10.0.0.1 Up Normal 224.32 KB 2.81% >> 120032232535256657419697899804576121325 >> 10.0.0.2 Up Normal 201.21 KB 1.40% >> 122418483936398408449402823221419958061 >> 10.0.0.3 Up Normal 218.13 KB 0.70% >> 123611609636969283964255284929841876429 >> 10.0.0.6 Up Normal 242.93 KB 0.70% >> 124804735337540159479107746638263794797 >> >> >> Address Status State Load Owns Token >> >> 124804735337540159479107746638263794797 >> 10.0.0.5 Up Leaving 225.61 KB 94.39% >> 115259729732973155360288052970888447854 >> 10.0.0.1 Up Normal 214.39 KB 2.81% >> 120032232535256657419697899804576121325 >> 10.0.0.2 Up Normal 201.21 KB 1.40% >> 122418483936398408449402823221419958061 >> 10.0.0.3 Up Normal 218.13 KB 0.70% >> 123611609636969283964255284929841876429 >> 10.0.0.4 Up Normal 220.77 KB 0.35% >> 124208172487254721721681515784052835613 >> 10.0.0.6 Up Normal 248.08 KB 0.35% >> 124804735337540159479107746638263794797 >> >> >> >> 124804735337540159479107746638263794797 >> 10.0.0.1 Up Normal 214.39 KB 97.19% >> 120032232535256657419697899804576121325 >> 10.0.0.2 Up Normal 205.47 KB 1.40% >> 122418483936398408449402823221419958061 >> 10.0.0.3 Up Normal 218.13 KB 0.70% >> 123611609636969283964255284929841876429 >> 10.0.0.4 Up Normal 220.77 KB 0.35% >> 124208172487254721721681515784052835613 >> 10.0.0.5 Up Normal 220.63 KB 0.18% >> 124506453912397440600394631211158315205 >> 10.0.0.6 Up Normal 248.08 KB 0.18% >> 124804735337540159479107746638263794797 >> >> >> 97.19% ... awesome. >> >> >> On Mon, Mar 14, 2011 at 10:47 PM, Narendra Sharma >> wrote: >>> On the same page there is a section on Load Balance that talks about python >>> script to compute tokens. I believe your question is more about assigning >>> new tokens and not compute tokens. >>> >>> 1. "nodetool loadbalance" will result in recomputation of tokens. It will >>> pick tokens based on the load and not the once assigned by you. >>> 2. You can either use decommission and bootstrap with new tokens OR Use >>> "nodetool move" >>> >>> Thanks, >>> Naren >> > > > > -- > Jonathan Ellis > Project Chair, Apache Cassandra > co-founder of DataStax, the source for professional Cassandra support > http://www.datastax.com --00235446fe4cce4448049e7941b1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Yes, a lot of what is on the wiki makes perfect sense when read the righ= t way.=A0 suppose there arent enough pictures or before/after info online t= o help the knowledge flow.=A0

On Mar 14, 2011 11:52 PM, "Jonathan Ellis&q= uot; <jbellis@gmail.com> wro= te:
> You should read http://wiki.apache.org/cassandra/Operations before
> running loadbalance.
>
> On Mon, Mar 14, 2011 at 5:27 PM,= Sasha Dolgy <sdolgy@gmail.com&g= t; wrote:
>> With my six node cluster ... nodetool loadbalance sho= uld be run on one
>> node or all six? =A0I run it on one and the ownership percentage g= ets
>> even more unbalanced. =A0So... in the spirit of the evening= , I run it on
>> another node ..... as you see, the ownership % ke= eps increasing and
>> the token numbers keep increasing. =A0is this expected? =A0I would= have
>> hoped that the behaviour would be a little bit different.= =A0Maybe I've
>> missed something big....
>>
>= >
>>
>> Address =A0 =A0 =A0 =A0 Status State =A0 Load =A0 =A0 = =A0 =A0 =A0 =A0Owns =A0 =A0Token
>>
>> 124804735337540159= 479107746638263794797
>> 10.0.0.1 =A0Up =A0 =A0 Normal =A0225 KB = =A0 =A0 =A0 =A0 =A040.78%
>> 2405308819019566343941993516323288193= 6
>> 10.0.0.2 =A0 =A0Up =A0 =A0 Normal =A0201.21 KB =A0 =A0 =A0 19.17%<= br>>> 56667357399723182105247119364967854254
>> 10.0.0.3 =A0= Up =A0 =A0 Normal =A0213.15 KB =A0 =A0 =A0 17.61%
>> 866247129192= 72143003828971968762407027
>> 10.0.0.4 =A0 Up =A0 =A0 Normal =A0214.54 KB =A0 =A0 =A0 11.22%
= >> 105714724128406151241468359303513100912
>> 10.0.0.5 =A0Up= =A0 =A0 Normal =A0206.39 KB =A0 =A0 =A0 5.61%
>> 1152597297329731= 55360288052970888447854
>> 10.0.0.6 =A0 =A0Up =A0 =A0 Normal =A0242.93 KB =A0 =A0 =A0 5.61%>> 124804735337540159479107746638263794797
>>
>><= br>>> Address =A0 =A0 =A0 =A0 Status State =A0 Load =A0 =A0 =A0 =A0 = =A0 =A0Owns =A0 =A0Token
>>
>> 124804735337540159479107746638263794797
>> 10.0.0.2 =A0 = =A0Up =A0 =A0 Normal =A0206.15 KB =A0 =A0 =A0 59.95%
>> 5666735739= 9723182105247119364967854254
>> 10.0.0.3 =A0 Up =A0 =A0 Normal =A0= 218.1 KB =A0 =A0 =A0 =A017.61%
>> 86624712919272143003828971968762407027
>> 10.0.0.4 =A0 Up= =A0 =A0 Normal =A0219.48 KB =A0 =A0 =A0 11.22%
>> 105714724128406= 151241468359303513100912
>> 10.0.0.5 =A0Up =A0 =A0 Normal =A0216.3= 1 KB =A0 =A0 =A0 5.61%
>> 115259729732973155360288052970888447854
>> 10.0.0.1 =A0Up= =A0 =A0 Normal =A0224.32 KB =A0 =A0 =A0 2.81%
>> 1200322325352566= 57419697899804576121325
>> 10.0.0.6 =A0 =A0Up =A0 =A0 Normal =A024= 2.93 KB =A0 =A0 =A0 2.81%
>> 124804735337540159479107746638263794797
>>
>>>> Address =A0 =A0 =A0 =A0 Status State =A0 Load =A0 =A0 =A0 =A0 =A0= =A0Owns =A0 =A0Token
>>
>> 12480473533754015947910774663= 8263794797
>> 10.0.0.3 =A0 Up =A0 =A0 Normal =A0218.1 KB =A0 =A0 = =A0 =A077.56%
>> 86624712919272143003828971968762407027
>> 10.0.0.4 =A0 Up= =A0 =A0 Normal =A0225.71 KB =A0 =A0 =A0 11.22%
>> 105714724128406= 151241468359303513100912
>> 10.0.0.5 =A0Up =A0 =A0 Normal =A0216.3= 1 KB =A0 =A0 =A0 5.61%
>> 115259729732973155360288052970888447854
>> 10.0.0.1 =A0Up= =A0 =A0 Normal =A0224.32 KB =A0 =A0 =A0 2.81%
>> 1200322325352566= 57419697899804576121325
>> 10.0.0.2 =A0 =A0Up =A0 =A0 Normal =A020= 1.21 KB =A0 =A0 =A0 1.40%
>> 122418483936398408449402823221419958061
>> 10.0.0.6 =A0 = =A0Up =A0 =A0 Normal =A0242.93 KB =A0 =A0 =A0 1.40%
>> 12480473533= 7540159479107746638263794797
>>
>> Address =A0 =A0 =A0 = =A0 Status State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Owns =A0 =A0Token
>>
>> 124804735337540159479107746638263794797
>> 10= .0.0.4 =A0 Up =A0 =A0 Normal =A0225.71 KB =A0 =A0 =A0 88.78%
>> 10= 5714724128406151241468359303513100912
>> 10.0.0.5 =A0Up =A0 =A0 No= rmal =A0225.61 KB =A0 =A0 =A0 5.61%
>> 115259729732973155360288052970888447854
>> 10.0.0.1 =A0Up= =A0 =A0 Normal =A0224.32 KB =A0 =A0 =A0 2.81%
>> 1200322325352566= 57419697899804576121325
>> 10.0.0.2 =A0 =A0Up =A0 =A0 Normal =A020= 1.21 KB =A0 =A0 =A0 1.40%
>> 122418483936398408449402823221419958061
>> 10.0.0.3 =A0 U= p =A0 =A0 Normal =A0218.13 KB =A0 =A0 =A0 0.70%
>> 123611609636969= 283964255284929841876429
>> 10.0.0.6 =A0 =A0Up =A0 =A0 Normal =A02= 42.93 KB =A0 =A0 =A0 0.70%
>> 124804735337540159479107746638263794797
>>
>>>> Address =A0 =A0 =A0 =A0 Status State =A0 Load =A0 =A0 =A0 =A0 =A0= =A0Owns =A0 =A0Token
>>
>> 12480473533754015947910774663= 8263794797
>> 10.0.0.5 =A0Up =A0 =A0 Leaving 225.61 KB =A0 =A0 =A0= 94.39%
>> 115259729732973155360288052970888447854
>> 10.0.0.1 =A0Up= =A0 =A0 Normal =A0214.39 KB =A0 =A0 =A0 2.81%
>> 1200322325352566= 57419697899804576121325
>> 10.0.0.2 =A0 =A0Up =A0 =A0 Normal =A020= 1.21 KB =A0 =A0 =A0 1.40%
>> 122418483936398408449402823221419958061
>> 10.0.0.3 =A0 U= p =A0 =A0 Normal =A0218.13 KB =A0 =A0 =A0 0.70%
>> 123611609636969= 283964255284929841876429
>> 10.0.0.4 =A0 Up =A0 =A0 Normal =A0220.= 77 KB =A0 =A0 =A0 0.35%
>> 124208172487254721721681515784052835613
>> 10.0.0.6 =A0 = =A0Up =A0 =A0 Normal =A0248.08 KB =A0 =A0 =A0 0.35%
>> 12480473533= 7540159479107746638263794797
>>
>>
>>
>>= ; 124804735337540159479107746638263794797
>> 10.0.0.1 =A0Up =A0 =A0 Normal =A0214.39 KB =A0 =A0 =A0 97.19%
&= gt;> 120032232535256657419697899804576121325
>> 10.0.0.2 =A0 = =A0Up =A0 =A0 Normal =A0205.47 KB =A0 =A0 =A0 1.40%
>> 12241848393= 6398408449402823221419958061
>> 10.0.0.3 =A0 Up =A0 =A0 Normal =A0218.13 KB =A0 =A0 =A0 0.70%
&= gt;> 123611609636969283964255284929841876429
>> 10.0.0.4 =A0 Up= =A0 =A0 Normal =A0220.77 KB =A0 =A0 =A0 0.35%
>> 1242081724872547= 21721681515784052835613
>> 10.0.0.5 =A0Up =A0 =A0 Normal =A0220.63 KB =A0 =A0 =A0 0.18%
&g= t;> 124506453912397440600394631211158315205
>> 10.0.0.6 =A0 =A0= Up =A0 =A0 Normal =A0248.08 KB =A0 =A0 =A0 0.18%
>> 12480473533754= 0159479107746638263794797
>>
>>
>> 97.19% ... awesome.
>>
>>= ;
>> On Mon, Mar 14, 2011 at 10:47 PM, Narendra Sharma
>>= <narendra.sharma@gmail.com= > wrote:
>>> On the same page there is a section on Load Balance that talks= about python
>>> script to compute tokens. I believe your ques= tion is more about assigning
>>> new tokens and not compute tok= ens.
>>>
>>> 1. "nodetool loadbalance" will resul= t in recomputation of tokens. It will
>>> pick tokens based on = the load and not the once assigned by you.
>>> 2. You can eithe= r use decommission and bootstrap with new tokens OR Use
>>> "nodetool move"
>>>
>>> Than= ks,
>>> Naren
>>
>
>
>
> --=
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co= -founder of DataStax, the source for professional Cassandra support
> http://www.datastax.com
--00235446fe4cce4448049e7941b1--