From user-return-28358-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Sat Aug 25 06:53:55 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E7095D727 for ; Sat, 25 Aug 2012 06:53:55 +0000 (UTC) Received: (qmail 47817 invoked by uid 500); 25 Aug 2012 06:53:53 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 46968 invoked by uid 500); 25 Aug 2012 06:53:46 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 46940 invoked by uid 99); 25 Aug 2012 06:53:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Aug 2012 06:53:45 +0000 X-ASF-Spam-Status: No, hits=1.0 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS,TRACKER_ID X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [216.82.249.131] (HELO mail28.messagelabs.com) (216.82.249.131) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 25 Aug 2012 06:53:40 +0000 X-Env-Sender: Bryce.Godfrey@azaleos.com X-Msg-Ref: server-10.tower-28.messagelabs.com!1345877597!25131253!1 X-Originating-IP: [96.31.162.44] X-StarScan-Received: X-StarScan-Version: 6.6.1.3; banners=-,-,- X-VirusChecked: Checked Received: (qmail 504 invoked from network); 25 Aug 2012 06:53:17 -0000 Received: from unknown (HELO smtp.azaleos.net) (96.31.162.44) by server-10.tower-28.messagelabs.com with AES128-SHA encrypted SMTP; 25 Aug 2012 06:53:17 -0000 Received: from FISH-MBX-02.azaleos.net ([fe80::4918:2597:a7be:1075]) by FISH-HUB-01.azaleos.net ([fe80::ecdb:527f:9348:37e%11]) with mapi id 14.03.0047.000; Fri, 24 Aug 2012 23:53:16 -0700 From: Bryce Godfrey To: "user@cassandra.apache.org" Subject: RE: Expanding cluster to include a new DR datacenter Thread-Topic: Expanding cluster to include a new DR datacenter Thread-Index: Ac2ApIfFaOPYziBeTeqfUNwTaymK8QAapDIAABKmdlAANGtEMAAShFoAAAYy6sA= Date: Sat, 25 Aug 2012 06:53:15 +0000 Message-ID: <054A19B0E41FDD43A58D2CC1E8C3FF5B1E6397BB@FISH-MBX-02.azaleos.net> References: <054A19B0E41FDD43A58D2CC1E8C3FF5B1E637337@FISH-MBX-02.azaleos.net> <054A19B0E41FDD43A58D2CC1E8C3FF5B1E637B3A@FISH-MBX-02.azaleos.net> <054A19B0E41FDD43A58D2CC1E8C3FF5B1E63928D@FISH-MBX-02.azaleos.net> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.20.0.100] Content-Type: multipart/alternative; boundary="_000_054A19B0E41FDD43A58D2CC1E8C3FF5B1E6397BBFISHMBX02azaleo_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_054A19B0E41FDD43A58D2CC1E8C3FF5B1E6397BBFISHMBX02azaleo_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Yes [default@unknown] describe cluster; Cluster Information: Snitch: org.apache.cassandra.locator.PropertyFileSnitch Partitioner: org.apache.cassandra.dht.RandomPartitioner Schema versions: 9511e292-f1b6-3f78-b781-4c90aeb6b0f6: [10.20.8.4, 10.20.8.5, 10.20.= 8.1, 10.20.8.2, 10.20.8.3] From: Mohit Anchlia [mailto:mohitanchlia@gmail.com] Sent: Friday, August 24, 2012 1:55 PM To: user@cassandra.apache.org Subject: Re: Expanding cluster to include a new DR datacenter That's interesting can you do describe cluster? On Fri, Aug 24, 2012 at 12:11 PM, Bryce Godfrey > wrote: So I'm at the point of updating the keyspaces from Simple to NetworkTopolog= y and I'm not sure if the changes are being accepted using Cassandra-cli. I issue the change: [default@EBonding] update keyspace EBonding ... with placement_strategy =3D 'org.apache.cassandra.locator.NetworkTo= pologyStrategy' ... and strategy_options=3D{Fisher:2}; 9511e292-f1b6-3f78-b781-4c90aeb6b0f6 Waiting for schema agreement... ... schemas agree across the cluster Then I do a describe and it still shows the old strategy. Is there somethi= ng else that I need to do? I've exited and restarted Cassandra-cli and it = still shows the SimpleStrategy for that keyspace. Other nodes show the sam= e information. [default@EBonding] describe EBonding; Keyspace: EBonding: Replication Strategy: org.apache.cassandra.locator.SimpleStrategy Durable Writes: true Options: [replication_factor:2] From: Bryce Godfrey [mailto:Bryce.Godfrey@azaleos.com] Sent: Thursday, August 23, 2012 11:06 AM To: user@cassandra.apache.org Subject: RE: Expanding cluster to include a new DR datacenter Thanks for the information! Answers my questions. From: Tyler Hobbs [mailto:tyler@datastax.com] Sent: Wednesday, August 22, 2012 7:10 PM To: user@cassandra.apache.org Subject: Re: Expanding cluster to include a new DR datacenter If you didn't see this particular section, you may find it useful: http://w= ww.datastax.com/docs/1.1/operations/cluster_management#adding-a-data-center= -to-a-cluster Some comments inline: On Wed, Aug 22, 2012 at 3:43 PM, Bryce Godfrey > wrote: We are in the process of building out a new DR system in another Data Cente= r, and we want to mirror our Cassandra environment to that DR. I have a co= uple questions on the best way to do this after reading the documentation o= n the Datastax website. We didn't initially plan for this to be a DR setup= when first deployed a while ago due to budgeting, but now we need to. So = I'm just trying to nail down the order of doing this as well as any potenti= al issues. For the nodes, we don't plan on querying the servers in this DR until we fa= il over to this data center. We are going to have 5 similar nodes in the = DR, should I join them into the ring at token+1? Join them at token+10 just to leave a little space. Make sure you're using= LOCAL_QUORUM for your queries instead of regular QUORUM. All keyspaces are set to the replication strategy of SimpleStrategy. Can I= change the replication strategy after joining the new nodes in the DR to N= etworkTopologyStategy with the updated replication factor for each dr? Switch your keyspaces over to NetworkTopologyStrategy before adding the new= nodes. For the strategy options, just list the first dc until the second = is up (e.g. {main_dc: 3}). Lastly, is changing snitch from default of SimpleSnitch to RackInferringSni= tch going to cause any issues? Since its in the Cassandra.yaml file I assu= me a rolling restart to pick up the value would be ok? This is the first thing you'll want to do. Unless your node IPs would natu= rally put all nodes in a DC in the same rack, I recommend using PropertyFil= eSnitch, explicitly using the same rack. (I tend to prefer PFSnitch regard= less; it's harder to accidentally mess up.) A rolling restart is required = to pick up the change. Make sure to fill out cassandra-topology.properties= first if using PFSnitch. This is all on Cassandra 1.1.4, Thanks for any help! -- Tyler Hobbs DataStax --_000_054A19B0E41FDD43A58D2CC1E8C3FF5B1E6397BBFISHMBX02azaleo_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Yes

 <= /p>

[default@unknown] describ= e cluster;

Cluster Information:=

   Snitch: org.= apache.cassandra.locator.PropertyFileSnitch

   Partitioner:= org.apache.cassandra.dht.RandomPartitioner

   Schema versi= ons:

    &= nbsp;   9511e292-f1b6-3f78-b781-4c90aeb6b0f6: [10.20.8.4, 10.20.8= .5, 10.20.8.1, 10.20.8.2, 10.20.8.3]

 <= /p>

From: Mohit = Anchlia [mailto:mohitanchlia@gmail.com]
Sent: Friday, August 24, 2012 1:55 PM
To: user@cassandra.apache.org
Subject: Re: Expanding cluster to include a new DR datacenter

 

That's interesting ca= n you do describe cluster?

On Fri, Aug 24, 2012 at 12:11 PM, Bryce Godfrey <= Bryce.Godfre= y@azaleos.com> wrote:

So I’m at the point of updating t= he keyspaces from Simple to NetworkTopology and I’m not sure if the changes are being accepted using Cassandra-cli.

 

I issue the change:

 

[default@EBonding] update keyspace EBon= ding

...     with placem= ent_strategy =3D 'org.apache.cassandra.locator.NetworkTopologyStrategy'

...     and strateg= y_options=3D{Fisher:2};

9511e292-f1b6-3f78-b781-4c90aeb6b0f6

Waiting for schema agreement...<= o:p>

... schemas agree across the cluster

 

Then I do a describe and it still shows= the old strategy.  Is there something else that I need to do?  I’ve exited and restarted Cassandra-cli and it still shows= the SimpleStrategy for that keyspace.  Other nodes show the same info= rmation.

 

[default@EBonding] describe EBonding;

Keyspace: EBonding:

  Replication Strategy: org.apache= .cassandra.locator.SimpleStrategy

  Durable Writes: true=

    Options: [replicatio= n_factor:2]

 

 

From: Bryce Godfrey [mailt= o:Bryce.Godf= rey@azaleos.com]
Sent: Thursday, August 23, 2012 11:06 AM
To: u= ser@cassandra.apache.org
Subject: RE: Expanding cluster to include a new DR datacenter
=

 

Thanks for the information!  Answe= rs my questions.

 

From: Tyler Hobbs [mailto:tyler@datastax.com<= /a>]
Sent: Wednesday, August 22, 2012 7:10 PM
To:
u= ser@cassandra.apache.org
Subject: Re: Expanding cluster to include a new DR datacenter
=

 

If you didn't see this particular section, you may find it useful: http://www.datastax.com/docs/1.1/operations/cluster_management#adding-a-dat= a-center-to-a-cluster

Some comments inline:

On Wed, Aug 22, 2012 at 3:43 PM, Bryce Godfrey <Bryce.Godfrey@azaleos.com> wrote:

We are in the process of building out a new DR system in another D= ata Center, and we want to mirror our Cassandra environment to that DR.&nbs= p; I have a couple questions on the best way to do this after reading the documentation on the Datastax website.&nb= sp; We didn’t initially plan for this to be a DR setup when first dep= loyed a while ago due to budgeting, but now we need to.  So I’m = just trying to nail down the order of doing this as well as any potential issues.

 

For the nodes, we don’t plan on querying the servers in this= DR until we fail over to this data center.   We are going to hav= e 5 similar nodes in the DR, should I join them into the ring at token+1?


Join them at token+10 just to leave a little space.  Make sure you= 're using LOCAL_QUORUM for your queries instead of regular QUORUM.
 

 

All keyspaces are set to the replication strategy of SimpleStrateg= y.  Can I change the replication strategy after joining the new nodes = in the DR to NetworkTopologyStategy with the updated replication factor for each dr?


Switch your keyspaces over to NetworkTopologyStrategy before adding the new= nodes.  For the strategy options, just list the first dc until the se= cond is up (e.g. {main_dc: 3}).
 

 

Lastly, is changing snitch from default of SimpleSnitch to RackInf= erringSnitch going to cause any issues?  Since its in the Cassandra.ya= ml file I assume a rolling restart to pick up the value would be ok?


This is the first thing you'll want to do.  Unless your node IPs would= naturally put all nodes in a DC in the same rack, I recommend using Proper= tyFileSnitch, explicitly using the same rack.  (I tend to prefer PFSni= tch regardless; it's harder to accidentally mess up.)  A rolling restart is required to pick up the change. = Make sure to fill out cassandra-topology.properties first if using PFSnitc= h.
 

 

This is all on Cassandra 1.1.4, Thanks for any help!

 

 




--
Tyler Hobbs
DataStax<= /span>

 

--_000_054A19B0E41FDD43A58D2CC1E8C3FF5B1E6397BBFISHMBX02azaleo_--