Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: softfail (athena.apache.org: transitioning domain of
 lolitushka@gmail.com does not designate 132.72.126.41 as permitted sender)
Message-ID: <5270402A.70105@gmail.com>
Date: Wed, 30 Oct 2013 01:09:30 +0200
From: Piavlo <lolitushka@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:15.0) Gecko/20120827 Thunderbird/15.0
MIME-Version: 1.0
To: user@cassandra.apache.org
Subject: not even number of keys per CFs in fully balanced cluster with random
 partitioner
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

  Hi,

There is a 12 node cluster , still stuck on 1.0.8.
All nodes in the cluster ring are balanced.
Using random partitioner.
All CFs use compression.
Data size on nodes varies from 40G to 75G.
This variance is not due to the bigger nodes having more uncompacted 
sstables than others.
Most biggest CFs have exact same row keys, just store different data, so 
data for same same key should end up on same node for these CFs.
The keys estimate for each of these biggest CF on the nodes with larger 
data size  is almost twice larger than key estimate on the nodes with 
smallest data size, thus proportional to the data size on the node. 
These CFs have about 50-100 millions for rows per node.

I can't understand how statistically it's possible that with random 
partitioner some nodes have x2 more keys than others with 50-100 
millions of keys per node.
Any ideas how it's possible?
Anything else I can check?

tnx
Alex