Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AA64B80B6 for ; Thu, 18 Aug 2011 22:44:14 +0000 (UTC) Received: (qmail 59744 invoked by uid 500); 18 Aug 2011 22:44:12 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59673 invoked by uid 500); 18 Aug 2011 22:44:11 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59659 invoked by uid 99); 18 Aug 2011 22:44:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2011 22:44:11 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a42.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Aug 2011 22:44:04 +0000 Received: from homiemail-a42.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a42.g.dreamhost.com (Postfix) with ESMTP id 9E1AC68C065 for ; Thu, 18 Aug 2011 15:43:42 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=content-type :mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; q=dns; s= thelastpickle.com; b=ml6p6+zjjh8O4vZxqvTd1vzeriV7C7hgtPqGli3PsVD GMpad5aRNpokd6ObFQ9OM/P8WxkQIdc6OX3W1Q2YF8TyjA4mVqQiWK4SIDIJWqjW PvOEFJUleN/29T69qO5OepOrd70O1b1w32VPTS9pCX+7y/TCihQQnvMGzM+dAK9M = DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h= content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; s= thelastpickle.com; bh=S9dsQ+ZnLcDOMAsQ7dRwfab2enA=; b=srcxUZ3miJ nIwy/uCRI8I8U1nYGeMJrt2fQpkwZlkJHgPdJzzrzmXIThtAlgH/P6YAFE/gs6XU eFTDRvX1chu2SMtBikBsuYme9m+V/u/wfIiKXyA7qt7ac0APRLTkPLec7vnU6k14 3UGtKRwrmfu2QXaMGyFxSSQMoJPzcMQ2s= Received: from [172.16.1.2] (219-89-2-67.dialup.xtra.co.nz [219.89.2.67]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a42.g.dreamhost.com (Postfix) with ESMTPSA id 39B6E68C05D for ; Thu, 18 Aug 2011 15:43:42 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Apple Message framework v1244.3) Subject: Re: Node out of sync From: aaron morton In-Reply-To: Date: Fri, 19 Aug 2011 10:43:37 +1200 Content-Transfer-Encoding: quoted-printable Message-Id: <6E8FBEE3-E15A-4049-AE62-5E206ECB25C3@thelastpickle.com> References: To: user@cassandra.apache.org X-Mailer: Apple Mail (2.1244.3) X-Virus-Checked: Checked by ClamAV on apache.org Try a restart on that guy with and with the JVM option = -dcassandra.load_ring_state=3Dfalse (see cassandra-env.sh).=20 If that does not fix it=85. = http://www.datastax.com/docs/0.8/troubleshooting/index#view-of-ring-differ= s-between-some-nodes Cheers ----------------- Aaron Morton Freelance Cassandra Developer @aaronmorton http://www.thelastpickle.com On 19/08/2011, at 5:49 AM, Ian Danforth wrote: > All, >=20 > One node in my cluster returns a different answer for nodetool ring. = It seems to be ignorant of one of the other nodes. I've verified that = all nodes can ping each other without difficulty.=20 >=20 > Here is the proper response: >=20 > Address DC Rack Status State Load = Owns Token =20 > = 127605887595351923798765477786913079296 =20 > 10.123.7.163 datacenter1 rack1 Up Normal 22.21 GB = 25.00% 0 =20 > 10.223.7.129 datacenter1 rack1 Up Normal 19.75 GB = 25.00% 42535295865117307932921825928971026432 =20 > 10.124.139.202 datacenter1 rack1 Up Normal 20.63 GB = 25.00% 85070591730234615865843651857942052864 =20 > 10.90.229.212 datacenter1 rack1 Up Normal 20.56 GB = 25.00% 127605887595351923798765477786913079296 >=20 > And here is the out of sync response from .129: >=20 > Address DC Rack Status State Load = Owns Token =20 > = 127605887595351923798765477786913079296 =20 > 10.123.7.163 datacenter1 rack1 Up Normal 22.21 GB = 25.00% 0 =20 > 10.223.7.129 datacenter1 rack1 Up Normal 19.76 GB = 25.00% 42535295865117307932921825928971026432 =20 > 10.90.229.212 datacenter1 rack1 Up Normal 20.56 GB = 50.00% 127605887595351923798765477786913079296 >=20 > How can I get .129 to acknowledge the proper state of the ring? >=20 > Thanks in advance, >=20 > Ian