Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of etamme@gmail.com designates
 209.85.161.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type;
        b=PdVEDmVEF1NWkmmJjTbDo6RFl9jjewFIygyPgxmZMI+bbqF9XkfHSJiXZTkzD7AvLd
         vRi3FX7I31ahuOxagu6Px5C2//uBKlJz0VUXXDYQWvVCqdrYmDbxpcKCTeWmCir34qLm
         VQ0EMFupSkdfhBq1BvIrSKcdy5MA7jCwWYgOk=
MIME-Version: 1.0
Date: Mon, 2 May 2011 14:40:32 -0400
Message-ID: <BANLkTi=tf7=RLxHfT504T0jq9k_vT9RemA@mail.gmail.com>
Subject: Replica data distributing between racks
From: Eric tamme <etamme@gmail.com>
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1

I am experiencing an issue where replication is not being distributed
between racks when using PropertyFileSnitch in conjunction with
NetworkTopologyStrategy.

I am running 0.7.3 from a tar.gz on  cassandra.apache.org

I have 4 nodes, 2 data centers, and 2 racks in each data center.  Each
rack has 1 node.

I have even token distribution so that each node gets 25%:

0
425352958651173079329218259289
71026432
85070591730234615865843651857942052864
127605887595351923798765477786913079296

My cassandra-topology.properties is as follows:

# Cassandra Node IP=Data Center:Rack
ffff\:0\:ffff\:eeee\:\:fffe=NY1:RAC1
ffff\:0\:ffff\:eeee\:\:ffff=NY1:RAC2

ffff\:0\:ffff\:ffff\:\:fffe=LA1:RAC1
ffff\:0\:ffff\:ffff\:\:ffff=LA1:RAC2

# default for unknown nodes
default=NY1:RAC1


My Keyspace replication strategy is as follows:
Keyspace: SipTrace:
  Replication Strategy: org.apache.cassandra.locator.NetworkTopologyStrategy
    Options: [LA1:1,NY1:1]

So each data center should get 1 copy of the data, and this does
happen.  The problem is that the replicated copies get pinned to the
first host configured in the properties file, from what I can discern,
and DO NOT distribute between racks.  So I have 2 nodes that have a 4
to 1 ratio of data compared to the other 2 nodes.  This is a problem!

Can any one please tell me if I have misconfigured this?  Or how I can
get replica data to distribute evenly between racks within a
datacenter?  I was led to believe that cassandra will try to
distribute between racks for replica data automatically under this
setup.

Thank you for your help in advance!

-Eric