That looks like the problem.  I added the node  with that machine as a seed, realized my mistake and restarted the machine with the correct seed. it joined the ring but without streaming.  Nodetool rebuild however doesn't seem to be fixing the situation.

I'll remove the node and try re-adding it after cleaning /var/lib/cassandra.

Andy




From: Richard Low [richard@wentnet.com]
Sent: 14 August 2013 20:11
To: user@cassandra.apache.org
Subject: Re: Vnodes, adding a node ?

On 14 August 2013 20:02, Andrew Cobley <a.e.cobley@dundee.ac.uk> wrote:
I have  small test cluster of 2 nodes.  I ran a stress test on it and with nodetool status received the following:

/usr/local/bin/apache-cassandra-2.0.0-rc1/log $ ../bin/nodetool status
Datacenter: datacenter1
=======================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address       Load       Tokens  Owns (effective)  Host ID                               Rack
UN  192.168.0.11  141.13 MB  256     49.2%             4d281e2e-efd9-4abf-bb70-ebdf8e2b4fc3  rack1
UN  192.168.0.10  145.59 MB  256     50.8%             7fc5795a-bd1b-4e42-88d6-024c5216a893  rack1

I then added a third node with no machines writing to the system.  Using nodetool status I got the following:

/usr/local/bin/apache-cassandra-2.0.0-rc1/log $ ../bin/nodetool status
Datacenter: datacenter1
=======================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address       Load       Tokens  Owns (effective)  Host ID                               Rack
UN  192.168.0.11  141.12 MB  256     32.2%             4d281e2e-efd9-4abf-bb70-ebdf8e2b4fc3  rack1
UN  192.168.0.10  145.59 MB  256     35.3%             7fc5795a-bd1b-4e42-88d6-024c5216a893  rack1
UN  192.168.0.12  111.9 KB   256     32.5%             e5e6d8bd-c652-4c18-8fa3-3d71471eee65  rack1

Is this correct ?  I was under the impression that adding a node to an existing cluster would distribute the load around the cluster. Am I perhaps missing a step or have a config error perhaps ?

How did you add the node?  It looks like it didn't bootstrap but just joined the ring.  You need to make sure the node is not set as a seed and that auto_bootstrap is true (the default).

Alternatively, you could run 'nodetool rebuild' to stream data from the other nodes.

Richard. 

The University of Dundee is a registered Scottish Charity, No: SC015096