Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates
 209.85.215.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAKc7CJRdGhHPr81qUSE-BEb-YmRatC++5o0J23WHbWC7DFwzbw@mail.gmail.com>
References: 
 <CAKc7CJRdGhHPr81qUSE-BEb-YmRatC++5o0J23WHbWC7DFwzbw@mail.gmail.com>
From: Jonathan Ellis <jbellis@gmail.com>
Date: Tue, 16 Aug 2011 13:54:35 -0500
Message-ID: 
 <CALdd-zj5VBg=HdnwgsGjG5sqBftEL8-y-1iLf=PoOR_+bPwaSg@mail.gmail.com>
Subject: Re: Partitioning, tokens, and sequential keys
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

what tokens did you end up using?

are you sure it's actually due to different amounts of rows?  have you
run cleanup and compact to make sure it's not unused data / obsolete
replicas taking up the space?

On Tue, Aug 16, 2011 at 1:41 PM, David McNelis
<dmcnelis@agentisenergy.com> wrote:
> We are currently running a three node cluster where we assigned the initi=
al
> tokens using the Python script that is in the Wiki, and we're currently
> using the Random Partitioner, RF=3D1, Cassandra 0.8 from the Riptano RPM
> ....however we're seeing one node taken on over 60% of the data as we loa=
d
> data.
> Our keys are sequential, and can range from 0 to 2^64, though in practice
> we're between 1 and 2,000,000,000, with the current =A0max around 50,000.=
 =A0 In
> order to balance out the =A0load would we be best served changing our tok=
ens
> to make the top and bottom 1/3rd of the node go to the previous and next
> nodes respectively, then running nodetool move?
> Even if we do that, it would seem that we'd likely continue to run into t=
his
> sort of issue as =A0we =A0add =A0additionally=A0data... would we be bette=
r served
> with a different Partitioner strategy? =A0Or will we need to very activel=
y
> manage our tokens to avoid getting into an unbalanced situation?
>
> --
> David McNelis
> Lead Software Engineer
> Agentis Energy
> www.agentisenergy.com
> o: 630.359.6395
> c: 219.384.5143
> A Smart Grid technology company focused on helping consumers of energy
> control an often under-managed resource.
>
>


--=20
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com