incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sergey Olefir <solf.li...@gmail.com>
Subject Re: Multiple Data Center shows very uneven load
Date Tue, 11 Dec 2012 14:00:34 GMT
Keith Wright wrote
> I have base Cassandra 1.1.7 installed in two data centers with 3 nodes
> each using a PropertyFileSnitch as outlined below. When I run a nodetool
> ring, I see a very uneven load. Any idea what I could be going on? I have
> not added/removed any nodes or changed the replication scheme or counts.


I have a very similar issue myself and would love to know what (if anything)
needs to be done (I'm using 1.1.6 at the moment). After stress-test (maximum
load), I had the following on my nodes (every IP is changed to the
corresponding fake number):


This already shows uneven load despite the fact that nodes actually hold the
same amount of data (according to effective-ownership and application design
/ token values).

However I then proceeded to drop the single keyspace that was on this
cluster and I got this:




Why 11.111.111.1 still has 700+ MB of data? I tried nodetool repair,
nodetool cleanup, and node restart (for 11.111.111.1) -- none of that helped
(it still had those 700+ MB of data).

Here's info from the filesystem on that node:



And here is syslog from Cassandra when I restarted 11.111.111.1 node:



I'd much appreciate if someone can provide some insight as to what is going
on and what (if anything) needs to be done.

Best regards,
Sergey



--
View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Multiple-Data-Center-shows-very-uneven-load-tp7584197p7584206.html
Sent from the cassandra-user@incubator.apache.org mailing list archive at Nabble.com.

Mime
View raw message