Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A242B9856 for ; Tue, 22 Nov 2011 21:31:04 +0000 (UTC) Received: (qmail 31502 invoked by uid 500); 22 Nov 2011 21:31:04 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 31485 invoked by uid 500); 22 Nov 2011 21:31:04 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 31477 invoked by uid 99); 22 Nov 2011 21:31:04 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Nov 2011 21:31:04 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Nov 2011 21:31:01 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 630F29765C for ; Tue, 22 Nov 2011 21:30:40 +0000 (UTC) Date: Tue, 22 Nov 2011 21:30:40 +0000 (UTC) From: "Gabriel Rosendorf (Commented) (JIRA)" To: commits@cassandra.apache.org Message-ID: <1535393277.3973.1321997440407.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <249156040.2871.1321977399894.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (CASSANDRA-3522) Fatal exception in thread Thread MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155450#comment-13155450 ] Gabriel Rosendorf commented on CASSANDRA-3522: ---------------------------------------------- Looks like this on one node: Address DC Rack Status State Load Owns Token 141784319550391032739561396922763706368 10.183.65.16 datacenter1 rack1 Up Normal 129.55 GB 16.67% 0 10.183.47.195 datacenter1 rack1 Up Normal 181.65 GB 33.33% 56713727820156407428984779325531226112 10.182.96.44 datacenter1 rack1 Up Normal 165.17 GB 16.67% 85070591730234615865843651857942052864 10.179.64.134 datacenter1 rack1 Up Normal 128.11 GB 16.67% 113427455640312814857969558651062452224 10.183.65.18 datacenter1 rack1 Up Normal 140.6 GB 16.67% 141784319550391032739561396922763706368 But on another node, it all of a sudden thinks that a node that I decommissioned yesterday is still part of the ring, just down: Address DC Rack Status State Load Owns Token 141784319550391032739561396922763706368 10.183.65.16 datacenter1 rack1 Up Normal 129.55 GB 16.67% 0 10.183.47.195 datacenter1 rack1 Up Normal 181.65 GB 33.33% 56713727820156407428984779325531226112 10.182.96.44 datacenter1 rack1 Up Normal 165.17 GB 16.67% 85070591730234615865843651857942052864 10.179.64.134 datacenter1 rack1 Up Normal 128.11 GB 16.67% 113427455640312814857969558651062452224 10.179.77.102 datacenter1 rack1 Down Normal ? 7.61% 126376470034382387444230631795475767049 10.183.65.18 datacenter1 rack1 Up Normal 140.6 GB 9.06% 141784319550391032739561396922763706368 > Fatal exception in thread Thread > --------------------------------- > > Key: CASSANDRA-3522 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3522 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 1.0.0 > Environment: Ubuntu 10.04 LTS - 8GB mem/ 360 GB disk - Hosted by RS > Reporter: Gabriel Rosendorf > Priority: Minor > > Seeing this recurring exception on all machines in a 5 node cluster. Recently upgraded to 1.0.0 from 0.7.2. > ERROR [MutationStage:20] 2011-11-22 15:25:55,758 AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread[MutationStage:20,5,main] > java.lang.AssertionError > at org.apache.cassandra.locator.TokenMetadata.getToken(TokenMetadata.java:273) > at org.apache.cassandra.service.StorageProxy$4.run(StorageProxy.java:350) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira