incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sameer Farooqui <>
Subject Advice on configuring a Brisk cluster across regions in Amazon
Date Fri, 17 Jun 2011 17:59:44 GMT

I'd like to learn how to set up a Brisk cluster with HA/DR in Amazon. Last
time I tried this a few months ago, it was tricky because we had to either
set up a VPN or hack the Cassandra source to get internode communications to
work across regions. But with v 0.8's new BriskSnitch or EC2Snitch, I'm
hoping it'll be a smooth process.

Here is the setup I'd like to set up:

Amazon East (DC 1)
- 4 vanilla Cassandra nodes in Availability Zone A (1 replica)
- 4 vanilla Cassandra nodes in Availability Zone B (1 replica)

Amazon West (DC 2)
- 4 Brisk nodes in Availability Zone A (1 replica)

The West Brisk nodes will be reserved for MapReduce analytics. All
reads/writes will go to the 8 Amazon East nodes. There will be 3 replicas.
We're planning on sending reads and writes to the East nodes with
consistency level of Quorum. So, as long as the cluster is healthy, writes
should be committed to 2 nodes in east and then a write successful will be
sent back to the client. In the background a 3rd write will be sent with
higher latency to the West brisk cluster.

We'll use the NetworkTopologyStrategy when we create the keyspace:
create keyspace MyCoolKeyspace
    with placement_strategy =
    and strategy_options=[{DC1:2, DC2:1}];


1) Must I use the Brisk binaries across all 12 nodes? Or can I use the
Cassandra 0.8 binary for the 8 nodes in Amazon East and Brisk1.0 in West?

2) Is this the correct token distribution if I plan on using Random
Partitioner? If I remember correctly, when configuring Cassandra across data
centers, each DC get's it's own ring.

Amazon East
node 0: 0 (also Cassandra seed)
node 1: 21267647932558653966460912964485513216
node 2: 42535295865117307932921825928971026432
node 3: 63802943797675961899382738893456539648
node 4: 85070591730234615865843651857942052864
node 5: 106338239662793269832304564822427566080
node 6: 127605887595351923798765477786913079296
node 7: 148873535527910577765226390751398592512

Amazon West (I added one to each one of these so that there are no duplicate
node 0: 1 (also Brisk seed)
node 1: 42535295865117307932921825928971026433
node 2: 85070591730234615865843651857942052865
node 3: 127605887595351923798765477786913079297

3) Should I be using the BriskSnitch or EC2Snitch? Can BriskSnitch traverse
across Amazon regions?

4) Is it correct that the Seeds will have to be defined in the YAML file
using Elastic IPs? For the listen address, can I use the Private IP on all
12 nodes?

View raw message