Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 44204 invoked from network); 26 Aug 2010 19:14:37 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 26 Aug 2010 19:14:37 -0000 Received: (qmail 90274 invoked by uid 500); 26 Aug 2010 19:14:36 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 90119 invoked by uid 500); 26 Aug 2010 19:14:35 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 90110 invoked by uid 99); 26 Aug 2010 19:14:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Aug 2010 19:14:35 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of static.void.dev@gmail.com designates 209.85.210.44 as permitted sender) Received: from [209.85.210.44] (HELO mail-pz0-f44.google.com) (209.85.210.44) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 26 Aug 2010 19:14:27 +0000 Received: by pzk6 with SMTP id 6so909187pzk.31 for ; Thu, 26 Aug 2010 12:14:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=mRhpxeQ7ufpeEYDiL2qOWlA0wYXr02tVFSv4w78AF+4=; b=pysR72bapW9kQeyBShGu6QJiEwbPq363xrz89E+2cEck/1glmqah/AVC3JA061ppjr l0qw3HWx8gLDpqM/+T0Xb9JxGZH71ggm6QNxZ+VYHCM7amIi7BiCeAmJ1aMg3uBsruLi wNgSFY7ruGzvlubVMAQHbqb/AWuDqJqSgHKus= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; b=g+UJw9kXXT3sd40yA5MsvLswSZKr9fLeUBHwWDYeVfoPKqqgr6pK2sz4xCXqPLlArG wXFQGHYT2B8Bgj1K1yGpCPxbzehj6lV9DxM7K9DG0YDQm+SJFdTEUfxAkRIRI0jiWRqk c7gxYfDX86Zs/4/336fJ/zkGx+dCeXClL1qjo= Received: by 10.115.109.6 with SMTP id l6mr11729907wam.164.1282850047150; Thu, 26 Aug 2010 12:14:07 -0700 (PDT) Received: from Robert-Zotters-MacBook-Pro.local ([208.66.27.203]) by mx.google.com with ESMTPS id g4sm4971938wae.14.2010.08.26.12.14.05 (version=SSLv3 cipher=RC4-MD5); Thu, 26 Aug 2010 12:14:05 -0700 (PDT) Message-ID: <4C76BCFC.9030201@gmail.com> Date: Thu, 26 Aug 2010 12:14:04 -0700 From: Mark User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.8) Gecko/20100802 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: user@cassandra.apache.org Subject: Re: StackOverflowError on startup! References: <4C76AF49.4020707@gmail.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 8/26/10 11:51 AM, Gary Dusbabek wrote: > I'm willing to bet this has something to do with the system table > initialization trying to delete its stats, which it can't do until > it's initialized, which means it tries to delete its stats, which it > can't do until it's initialized, which... you get the picture. > > The stack trace is very similar to > https://issues.apache.org/jira/browse/CASSANDRA-1382, which is fixed > and will be included in the next beta. > > Gary. > > On Thu, Aug 26, 2010 at 13:15, Mark wrote: >> Using 0.7beta1 and I noticed one of my nodes was not responding.. wtf? Went >> to restart and I got the following error. Any clues? >> >> Exception encountered during startup. >> java.lang.StackOverflowError >> at java.util.Vector.ensureCapacityHelper(Vector.java:238) >> at java.util.Vector.addElement(Vector.java:593) >> at java.lang.ClassLoader.addClass(ClassLoader.java:184) >> at java.lang.ClassLoader.defineClass1(Native Method) >> at java.lang.ClassLoader.defineClass(ClassLoader.java:632) >> at >> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) >> at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) >> at java.net.URLClassLoader.access$000(URLClassLoader.java:73) >> at java.net.URLClassLoader$1.run(URLClassLoader.java:212) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:205) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:319) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:264) >> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:332) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:208) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> at >> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:202) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:342) >> at >> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:308) >> at org.apache.cassandra.db.Table.(Table.java:245) >> at org.apache.cassandra.db.Table.open(Table.java:102) >> at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:196) >> at >> org.apache.cassandra.db.StatisticsTable.deleteSSTableStatistics(StatisticsTable.java:81) >> at >> org.apache.cassandra.io.sstable.SSTable.deleteIfCompacted(SSTable.java:136) >> >> Anyway to repair?