Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 23E0E109AB for ; Mon, 7 Apr 2014 13:49:35 +0000 (UTC) Received: (qmail 42976 invoked by uid 500); 7 Apr 2014 13:49:32 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 42637 invoked by uid 500); 7 Apr 2014 13:49:31 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 42628 invoked by uid 99); 7 Apr 2014 13:49:30 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2014 13:49:30 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gcdcu-cassandra-user-1@m.gmane.org designates 80.91.229.3 as permitted sender) Received: from [80.91.229.3] (HELO plane.gmane.org) (80.91.229.3) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Apr 2014 13:49:25 +0000 Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1WX9v4-0002lO-6g for user@cassandra.apache.org; Mon, 07 Apr 2014 15:49:02 +0200 Received: from c-24-0-89-25.hsd1.nj.comcast.net ([24.0.89.25]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 07 Apr 2014 15:49:02 +0200 Received: from oleg.dulin by c-24-0-89-25.hsd1.nj.comcast.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 07 Apr 2014 15:49:02 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: user@cassandra.apache.org From: Oleg Dulin Subject: Re: Why is my cluster imbalanced ? Date: Mon, 7 Apr 2014 09:48:50 -0400 Lines: 73 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: c-24-0-89-25.hsd1.nj.comcast.net User-Agent: Unison/2.1.10 X-Virus-Checked: Checked by ClamAV on apache.org Tupshin: For EC2, 3 us-east, would you recommend RF=3 ? That would make sense, wouldn't it... That's what I'll do for production. Oleg On 2014-04-07 12:23:51 +0000, Tupshin Harper said: > Your us-east datacenter, has RF=2, and 2 racks, which is the right way > to do it (I would rarely recommend using a different number of racks > than your RF). But by having three nodes on one rack (1b) and only one > on the other(1a), you are telling Cassandra to distribute the data so > that no two copies of the same partition exist on the same rack. > > So with rack ownership of 100% and 100% respectively, there is no even > way to distribute your data among those four nodes. > > tl;dr Switch node 2 to rack 1a. > > -Tupshin > > > > On Mon, Apr 7, 2014 at 8:08 AM, Oleg Dulin wrote: >> I added two more nodes on Friday, and moved tokens around. >> >> For four nodes, the tokesn should be: >> >> Node #1: 0 >> Node #2: 42535295865117307932921825928971026432 >> Node #3: 85070591730234615865843651857942052864 >> Node #4: 127605887595351923798765477786913079296 >> >> And yet my ring status shows this (for a specific keyspace). RF=2. >> >> Datacenter: us-east >> ========== >> Replicas: 2 >> >> Address Rack Status State Load Owns >> Token >> >> 42535295865117307932921825928971026432 >> x.x.x.1 1b Up Normal 13.51 GB 25.00% >> 127605887595351923798765477786913079296 >> x.x.x.2 1b Up Normal 4.46 GB 25.00% >> 85070591730234615865843651857942052164 >> x.x.x.3 1a Up Normal 62.58 GB 100.00% 0 >> x.x.x.4 1b Up Normal 66.71 GB 50.00% >> 42535295865117307932921825928971026432 >> >> Datacenter: us-west >> ========== >> Replicas: 1 >> >> Address Rack Status State Load Owns >> Token >> >> x.x.x.5 1b Up Normal 62.72 GB 100.00% 100 >> -- >> Regards, >> Oleg Dulin >> http://www.olegdulin.com -- Regards, Oleg Dulin http://www.olegdulin.com