If I chang= e a 1c to a 1d, what would I have to do to make sure data shuffles around c= orrectly? =A0Repair everywhere?

will
On Thu, Sep 6, 2012 at 2:09 PM, Tyler Hobbs <t= yler@datastax.com> wrote:
The main issue is that one of your us-east nodes is in rack 1d, while the r= estart are in rack 1c.=A0 With NTS and multiple racks, Cassandra will try u= se one node from each rack as a replica for a range until it either meets t= he RF for the DC, or runs out of racks, in which case it just picks nodes s= equentially going clockwise around the ring (starting from the range being = considered, not the last node that was chosen as a replica).

To fix this, you'll either need to make the 1d node a 1c node, or m= ake 42535295865117307932921825928971026432 a 1d node so that you're alt= ernating racks within that DC.

On Thu, Sep 6, 2012 at 12:54 PM, William Obe= rman wrote:
Hi,

I recently upgraded f= rom 0.8.x to 1.1.x (through 1.0 briefly) and nodetool -ring seems to have c= hanged from "owns" to "effectively owns". =A0"Effe= ctively owns"=A0seems to account for replication factor (RF). =A0I'= ;m ok with all of this, yet I still can't figure out what's up with= my cluster. =A0I have a=A0NetworkTopologyStrategy with two data centers (D= Cs) with RF/number nodes in DC combinations of:
DC Name, RF, # in DC
analytics, 1, 2
us-east, 3, 4=
So I'd expect 50% on each analytics node, and 75% for each u= s-east node. =A0Instead, I have two nodes in=A0us-east=A0with 50/100??? (th= e other two are 75/75 as expected).

Here is the output of nodetool (all nodes report the sa= me thing):
Address =A0 =A0 =A0 =A0 DC =A0 =A0 =A0 =A0 =A0Rack =A0 =A0 = =A0 =A0Status State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Effective-Ownership Tok= en =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A012760588759535192379876= 5477786913079296 =A0 =A0=A0
x.x.x.x =A0 us-east =A0 =A0 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal = =A094.57 GB =A0 =A0 =A0 =A075.00% =A0 =A0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0<= /div>
x.x.x.x=A0 =A0analytics =A0 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Norm= al =A060.64 GB =A0 =A0 =A0 =A050.00% =A0 =A0 =A0 =A0 =A0 =A0 =A01 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0
x.x.x.x=A0 =A0us-east =A0 =A0 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal = =A0131.76 GB =A0 =A0 =A0 75.00% =A0 =A0 =A0 =A0 =A0 =A0 =A04253529586511730= 7932921825928971026432 =A0 =A0 =A0
x.x.x.x=A0 =A0 us-east =A0 =A0= 1c =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal =A043.45 GB =A0 =A0 =A0 =A050.00% = =A0 =A0 =A0 =A0 =A0 =A0 =A085070591730234615865843651857942052864 =A0 =A0 = =A0
x.x.x.x=A0 =A0 analytics =A0 1d =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal = =A060.88 GB =A0 =A0 =A0 =A050.00% =A0 =A0 =A0 =A0 =A0 =A0 =A085070591730234= 615865843651857942052865 =A0 =A0 =A0
x.x.x.x=A0 =A0us-east =A0 = =A0 1d =A0 =A0 =A0 =A0 =A0Up =A0 =A0 Normal =A098.56 GB =A0 =A0 =A0 =A0100.= 00% =A0 =A0 =A0 =A0 =A0 =A0 127605887595351923798765477786913079296=A0

If I use cassandra-cli to do "show keyspaces= ;" I get (and again, all nodes report the same thing):
= Keyspace: civicscience:
=A0 Replication Strategy: org.apache.cass= andra.locator.NetworkTopologyStrategy
=A0 Durable Writes: true
=A0 =A0 Options: [analytics:1, us-e= ast:3]
I removed the output about all of my column families= (CFs), hopefully that doesn't matter.

Did I c= ompute the tokens wrong? =A0Is there a combination of nodetool commands I c= an run to migrate the data around to rebalance to 75/75/75/75? =A0I routine= ly run repair already. =A0And as the release notes required, I ran upgrades= stables during the upgrade process.

Before the upgrade, I was getting analytics =3D 0%, and= us-east =3D 25% on each node, which I expected for "owns".
=

will

--
Tyler Hobbs

DataStax
<= br>

-- Will Oberman
Civic Science, Inc.
3030 Penn Avenue., First Floor
= Pittsburgh, PA 15201
(M) 412-480-7835
(E) oberman@civicscience.com
--e89a8f643556453af504c90c6eb2--