From user-return-26605-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Fri Jun 1 21:04:05 2012 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 05AB39324 for ; Fri, 1 Jun 2012 21:04:05 +0000 (UTC) Received: (qmail 16306 invoked by uid 500); 1 Jun 2012 21:04:02 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 16284 invoked by uid 500); 1 Jun 2012 21:04:02 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 16274 invoked by uid 99); 1 Jun 2012 21:04:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Jun 2012 21:04:02 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FROM_12LTRDOM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [69.50.2.37] (HELO ht1.hostedexchange.local) (69.50.2.37) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Jun 2012 21:03:54 +0000 Received: from MBX5.hostedexchange.local ([fe80:0000:0000:0000:8c0c:a2b9:26.8.210.164]) by HT1.hostedexchange.local ([172.16.69.39]) with mapi; Fri, 1 Jun 2012 14:03:32 -0700 From: Curt Allred To: "user@cassandra.apache.org" Date: Fri, 1 Jun 2012 14:01:59 -0700 Subject: nodes moving spontaneously Thread-Topic: nodes moving spontaneously Thread-Index: Ac1AODBsN06Jm/PhSsWYt65oBkI18A== Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_AB8A0A8FFC4CF040AD75842A711E13580FDCD7FE7Dmbx5hostedexc_" MIME-Version: 1.0 --_000_AB8A0A8FFC4CF040AD75842A711E13580FDCD7FE7Dmbx5hostedexc_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable We have a 10 node cluster (v0.7.9) split into 2 datacenters. Three times w= e have seen nodes move themselves to different locations in the ring. In e= ach case, the move unbalanced the ring. In one case a node moved to the opp= osite side of the ring. Sometime after the first spontaneous move we started using Datastax OpsCent= er. The next 2 moves showed up in its event log like: 5/20/2012 11:23am - Info - Host 12.34.56.78 moved from '12345' to '54321' where '12345' and '54321' are the old and new tokens. Anyone know whats causing this? --_000_AB8A0A8FFC4CF040AD75842A711E13580FDCD7FE7Dmbx5hostedexc_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

We have a 10 nod= e cluster (v0.7.9) split into 2 datacenters.  Three times we have seen= nodes move themselves to different locations in the ring.  In each ca= se, the move unbalanced the ring. In one case a node moved to the opposite = side of the ring.

 

<= p class=3DMsoNormal>Sometime after the first spontaneous move we started us= ing Datastax OpsCenter.  The next 2 moves showed up in its event log l= ike:

5/20/2012 11:23am - Info -  Ho= st 12.34.56.78 moved from '12345' to '54321'

 

where '12345' and '54321' ar= e the old and new tokens.

 

Anyone know whats causing this?

<= p class=3DMsoNormal> 

= --_000_AB8A0A8FFC4CF040AD75842A711E13580FDCD7FE7Dmbx5hostedexc_--