From user-return-28606-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Thu Sep 6 17:55:13 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 555499086 for ; Thu, 6 Sep 2012 17:55:13 +0000 (UTC) Received: (qmail 83647 invoked by uid 500); 6 Sep 2012 17:55:10 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 83624 invoked by uid 500); 6 Sep 2012 17:55:10 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 83616 invoked by uid 99); 6 Sep 2012 17:55:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Sep 2012 17:55:10 +0000 X-ASF-Spam-Status: No, hits=3.4 required=5.0 tests=FROM_12LTRDOM,FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,TRACKER_ID X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 209.85.214.172 is neither permitted nor denied by domain of oberman@civicscience.com) Received: from [209.85.214.172] (HELO mail-ob0-f172.google.com) (209.85.214.172) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Sep 2012 17:55:02 +0000 Received: by obbwc20 with SMTP id wc20so3309791obb.31 for ; Thu, 06 Sep 2012 10:54:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=rd44ccYWWPIo1bUzfb36Xy/w2xv7Z2RhLjvQtDV6xiQ=; b=bZH9eKxbpKu50iqU1RPeGlZsrD19VZHP6sGh9LpuHHc/aDcRWBypPH0sdwoHWQ/WYB 5r7p+La2kDC1lAxsTDgoAkjT0t8ps53LcZcqJiOEr+KoYdJyLHo7bmaoyXr4JoiiPWdQ yQyLj1WtL0ae8pNT6tEQ/QRshrt5j/xGG0vA3Cj4PTrji6bAVCl3XRsly/BtvWKdgpdU H9FAsGfm+r6oMnkk96bu4J1dp5fQO8Vdp9HITezEEkpoeXzmNFMyUdbkwEhG/iZr60V3 1b/lykqolvrdqKNjhg9i/b1qFAgLDgKyu0ZBlmF+FJVW0q0R0COBM/sBoJiFnP4vTvk/ Q3cw== Received: by 10.60.19.37 with SMTP id b5mr3348783oee.16.1346954080690; Thu, 06 Sep 2012 10:54:40 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.10.162 with HTTP; Thu, 6 Sep 2012 10:54:20 -0700 (PDT) X-Originating-IP: [24.23.118.38] From: William Oberman Date: Thu, 6 Sep 2012 13:54:20 -0400 Message-ID: Subject: new "nodetool ring" output and unbalanced ring? To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=e89a8ff1c4b882227004c90c2fc0 X-Gm-Message-State: ALoCoQkBscnOcG2GPlrr5iz1PtPCP+p9AWUKNTYI9YeuIe5FGYlTaVfSxuXLNrMIERMB2sYoeHSb X-Virus-Checked: Checked by ClamAV on apache.org --e89a8ff1c4b882227004c90c2fc0 Content-Type: text/plain; charset=ISO-8859-1 Hi, I recently upgraded from 0.8.x to 1.1.x (through 1.0 briefly) and nodetool -ring seems to have changed from "owns" to "effectively owns". "Effectively owns" seems to account for replication factor (RF). I'm ok with all of this, yet I still can't figure out what's up with my cluster. I have a NetworkTopologyStrategy with two data centers (DCs) with RF/number nodes in DC combinations of: DC Name, RF, # in DC analytics, 1, 2 us-east, 3, 4 So I'd expect 50% on each analytics node, and 75% for each us-east node. Instead, I have two nodes in us-east with 50/100??? (the other two are 75/75 as expected). Here is the output of nodetool (all nodes report the same thing): Address DC Rack Status State Load Effective-Ownership Token 127605887595351923798765477786913079296 x.x.x.x us-east 1c Up Normal 94.57 GB 75.00% 0 x.x.x.x analytics 1c Up Normal 60.64 GB 50.00% 1 x.x.x.x us-east 1c Up Normal 131.76 GB 75.00% 42535295865117307932921825928971026432 x.x.x.x us-east 1c Up Normal 43.45 GB 50.00% 85070591730234615865843651857942052864 x.x.x.x analytics 1d Up Normal 60.88 GB 50.00% 85070591730234615865843651857942052865 x.x.x.x us-east 1d Up Normal 98.56 GB 100.00% 127605887595351923798765477786913079296 If I use cassandra-cli to do "show keyspaces;" I get (and again, all nodes report the same thing): Keyspace: civicscience: Replication Strategy: org.apache.cassandra.locator.NetworkTopologyStrategy Durable Writes: true Options: [analytics:1, us-east:3] I removed the output about all of my column families (CFs), hopefully that doesn't matter. Did I compute the tokens wrong? Is there a combination of nodetool commands I can run to migrate the data around to rebalance to 75/75/75/75? I routinely run repair already. And as the release notes required, I ran upgradesstables during the upgrade process. Before the upgrade, I was getting analytics = 0%, and us-east = 25% on each node, which I expected for "owns". will --e89a8ff1c4b882227004c90c2fc0 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi,

I recently upgraded from 0.8.x to 1.1.x (through 1.0= briefly) and nodetool -ring seems to have changed from "owns" to= "effectively owns". =A0"Effectively owns"=A0seems to a= ccount for replication factor (RF). =A0I'm ok with all of this, yet I s= till can't figure out what's up with my cluster. =A0I have a=A0Netw= orkTopologyStrategy with two data centers (DCs) with RF/number nodes in DC = combinations of:
DC Name, RF, # in DC
analytics, 1, 2
us-east, 3, 4=
So I'd expect 50% on each analytics node, and 75% for each u= s-east node. =A0Instead, I have two nodes in=A0us-east=A0with 50/100??? (th= e other two are 75/75 as expected).

Here is the output of nodetool (all nodes report the sa= me thing):
Address =A0 =A0 =A0 =A0 DC =A0 =A0 =A0 =A0 =A0Rack =A0 =A0 = =A0 =A0Status State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Effective-Ownership Tok= en =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A012760588759535192379876= 5477786913079296 =A0 =A0=A0
x.x.x.x =A0 us-east =A0 =A0 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal = =A094.57 GB =A0 =A0 =A0 =A075.00% =A0 =A0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0<= /div>
x.x.x.x=A0 =A0analytics =A0 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Norm= al =A060.64 GB =A0 =A0 =A0 =A050.00% =A0 =A0 =A0 =A0 =A0 =A0 =A01 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0
x.x.x.x=A0 =A0us-east =A0 =A0 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal = =A0131.76 GB =A0 =A0 =A0 75.00% =A0 =A0 =A0 =A0 =A0 =A0 =A04253529586511730= 7932921825928971026432 =A0 =A0 =A0
x.x.x.x=A0 =A0 us-east =A0 =A0= 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal =A043.45 GB =A0 =A0 =A0 =A050.00% = =A0 =A0 =A0 =A0 =A0 =A0 =A085070591730234615865843651857942052864 =A0 =A0 = =A0
x.x.x.x=A0 =A0 analytics =A0 1d =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal = =A060.88 GB =A0 =A0 =A0 =A050.00% =A0 =A0 =A0 =A0 =A0 =A0 =A085070591730234= 615865843651857942052865 =A0 =A0 =A0
x.x.x.x=A0 =A0us-east =A0 = =A0 1d =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal =A098.56 GB =A0 =A0 =A0 =A0100.= 00% =A0 =A0 =A0 =A0 =A0 =A0 127605887595351923798765477786913079296=A0

If I use cassandra-cli to do "show keyspaces= ;" I get (and again, all nodes report the same thing):
= Keyspace: civicscience:
=A0 Replication Strategy: org.apache.cass= andra.locator.NetworkTopologyStrategy
=A0 Durable Writes: true
=A0 =A0 Options: [analytics:1, us-e= ast:3]
I removed the output about all of my column families= (CFs), hopefully that doesn't matter.

Did I c= ompute the tokens wrong? =A0Is there a combination of nodetool commands I c= an run to migrate the data around to rebalance to 75/75/75/75? =A0I routine= ly run repair already. =A0And as the release notes required, I ran upgrades= stables during the upgrade process.

Before the upgrade, I was getting analytics =3D 0%, and= us-east =3D 25% on each node, which I expected for "owns".
=

will

--e89a8ff1c4b882227004c90c2fc0--