Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 39DC28793 for ; Thu, 18 Aug 2011 17:50:04 +0000 (UTC) Received: (qmail 83089 invoked by uid 500); 18 Aug 2011 17:50:01 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 83018 invoked by uid 500); 18 Aug 2011 17:50:00 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 83010 invoked by uid 99); 18 Aug 2011 17:50:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2011 17:50:00 +0000 X-ASF-Spam-Status: No, hits=3.3 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL,TO_NO_BRKTS_PCNT,TRACKER_ID X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [74.125.82.44] (HELO mail-ww0-f44.google.com) (74.125.82.44) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2011 17:49:51 +0000 Received: by wwf5 with SMTP id 5so1945777wwf.25 for ; Thu, 18 Aug 2011 10:49:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.227.38.66 with SMTP id a2mr883548wbe.43.1313689766830; Thu, 18 Aug 2011 10:49:26 -0700 (PDT) Received: by 10.227.203.16 with HTTP; Thu, 18 Aug 2011 10:49:26 -0700 (PDT) X-Originating-IP: [173.167.104.65] Date: Thu, 18 Aug 2011 10:49:26 -0700 Message-ID: Subject: Node out of sync From: Ian Danforth To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=002215b029d2e5a46404aacb3b66 X-Virus-Checked: Checked by ClamAV on apache.org --002215b029d2e5a46404aacb3b66 Content-Type: text/plain; charset=ISO-8859-1 All, One node in my cluster returns a different answer for nodetool ring. It seems to be ignorant of one of the other nodes. I've verified that all nodes can ping each other without difficulty. Here is the proper response: Address DC Rack Status State Load Owns Token 127605887595351923798765477786913079296 10.123.7.163 datacenter1 rack1 Up Normal 22.21 GB 25.00% 0 10.223.7.129 datacenter1 rack1 Up Normal 19.75 GB 25.00% 42535295865117307932921825928971026432 10.124.139.202 datacenter1 rack1 Up Normal 20.63 GB 25.00% 85070591730234615865843651857942052864 10.90.229.212 datacenter1 rack1 Up Normal 20.56 GB 25.00% 127605887595351923798765477786913079296 And here is the out of sync response from .129: Address DC Rack Status State Load Owns Token 127605887595351923798765477786913079296 10.123.7.163 datacenter1 rack1 Up Normal 22.21 GB 25.00% 0 10.223.7.129 datacenter1 rack1 Up Normal 19.76 GB 25.00% 42535295865117307932921825928971026432 10.90.229.212 datacenter1 rack1 Up Normal 20.56 GB 50.00% 127605887595351923798765477786913079296 How can I get .129 to acknowledge the proper state of the ring? Thanks in advance, Ian --002215b029d2e5a46404aacb3b66 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable All,

=A0One node in my cluster returns a different answe= r for nodetool ring. It seems to be ignorant of one of the other nodes. I&#= 39;ve verified that all nodes can ping each other without difficulty.=A0

Here is the proper response:

<= div>Address =A0 =A0 =A0 =A0 DC =A0 =A0 =A0 =A0 =A0Rack =A0 =A0 =A0 =A0Statu= s State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Owns =A0 =A0Token =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0
= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0127605887595351923798765477786913079296 =A0 =A0=A0
10.123.7.163 =A0 =A0datacenter1 rack1 =A0 =A0 =A0 Up =A0 =A0 Normal = =A022.21 GB =A0 =A0 =A0 =A025.00% =A00 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0
10.223.7.129 = =A0 =A0datacenter1 rack1 =A0 =A0 =A0 Up =A0 =A0 Normal =A019.75 GB =A0 =A0 = =A0 =A025.00% =A042535295865117307932921825928971026432 =A0 =A0 =A0
10.124.139.202 =A0datacenter1 rack1 =A0 =A0 =A0 Up =A0 =A0 Normal =A02= 0.63 GB =A0 =A0 =A0 =A025.00% =A085070591730234615865843651857942052864 =A0= =A0 =A0
10.90.229.212 =A0 datacenter1 rack1 =A0 =A0 =A0 Up =A0 = =A0 Normal =A020.56 GB =A0 =A0 =A0 =A025.00% =A0127605887595351923798765477= 786913079296

And here is the out of sync response from .129:

Address =A0 =A0 =A0 =A0 DC =A0 =A0 =A0 =A0 =A0= Rack =A0 =A0 =A0 =A0Status State =A0 Load =A0 =A0 =A0 =A0 =A0 =A0Owns =A0 = =A0Token =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0=A0
=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 =A0 =A0 =A0127605887595351923798765477786913079296 =A0 =A0=A0
10.123.7.163 =A0 =A0datacenter1 rack1 =A0 =A0 =A0 Up =A0 =A0 Normal =A022= .21 GB =A0 =A0 =A0 =A025.00% =A00 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0
10.223.7.129 =A0 =A0datacenter1 rack1 =A0 =A0 =A0 Up =A0 =A0 Normal = =A019.76 GB =A0 =A0 =A0 =A025.00% =A042535295865117307932921825928971026432= =A0 =A0 =A0
10.90.229.212 =A0 datacenter1 rack1 =A0 =A0 =A0 Up = =A0 =A0 Normal =A020.56 GB =A0 =A0 =A0 =A050.00% =A012760588759535192379876= 5477786913079296

How can I get .129 to acknowledge the proper stat= e of the ring?

Thanks in advance,

Ian
--002215b029d2e5a46404aacb3b66--