Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 51995 invoked from network); 1 Oct 2010 03:20:03 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 1 Oct 2010 03:20:03 -0000 Received: (qmail 34783 invoked by uid 500); 1 Oct 2010 03:20:01 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 34678 invoked by uid 500); 1 Oct 2010 03:19:57 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 34670 invoked by uid 99); 1 Oct 2010 03:19:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Oct 2010 03:19:57 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates 209.85.216.172 as permitted sender) Received: from [209.85.216.172] (HELO mail-qy0-f172.google.com) (209.85.216.172) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Oct 2010 03:19:50 +0000 Received: by qyk7 with SMTP id 7so29368qyk.10 for ; Thu, 30 Sep 2010 20:19:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=ANtNVXYs+yuASAzMiP6iUBJzir9iyE88C+EJQJtk4kg=; b=LvjWwTbHM1/PLlxAC3qABS2LCFmC5vQzzL0WkyFUxnVVs7udOTdUcCsxQt3mkm3phO 2hd0Ex7qqCcCtcxmkvyxCCaO55721WwSmQeM2/4H7Y5+ur3p5H3Y/mvf/iBowORLH77k FpcIq0RgObDB8eHRnqgQdbtv6mvsGviUPo6KE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=bQErjkiipqGMQlMbnm9LkciMQjNbeZzYHdyRrS70IGrLtTFupXo0caeyrp8sFuL5Of 5zx/sLUP5aHXfckaMUTJ1o9bliE03eaVKY97kS/nHDeTUVLhjeqwEhQt6vtADrLkZiln EgUGzwthcuekr2i815uPBrC8TMhQHPCBXsuwI= MIME-Version: 1.0 Received: by 10.220.122.105 with SMTP id k41mr1205601vcr.213.1285903165654; Thu, 30 Sep 2010 20:19:25 -0700 (PDT) Received: by 10.220.186.132 with HTTP; Thu, 30 Sep 2010 20:19:25 -0700 (PDT) In-Reply-To: References: <6503043b-5ed1-4015-934a-e7321f3216e1@me.com> Date: Thu, 30 Sep 2010 22:19:25 -0500 Message-ID: Subject: Re: NullPointerException from IndexSummary.complete on boot From: Jonathan Ellis To: user Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org aha, there was a bug in the cleanup for the System keyspace. patched: https://issues.apache.org/jira/browse/CASSANDRA-1564 On Thu, Sep 30, 2010 at 9:54 PM, Jonathan Ellis wrote: > they are cleaned out on every start, yes. =A0this is logged. > > On Thu, Sep 30, 2010 at 9:51 PM, Aaron Morton w= rote: >> No in my app. Only the default one in Keyspace1 which would not have bee= n in >> use. >> >> Out of interest, are these the same tmp files generated during (minor) >> compaction? Would they have been left over from a clumsy dev shutting do= wn >> the process during compaction? >> Looking at the timestamps on the files they have been hanging around for= a >> while. They are probably from an earlier install.=A0Is there any value i= n >> testing for and removing them on startup? >> Cheers >> Aaron >> On 01 Oct, 2010,at 03:33 PM, Jonathan Ellis wrote: >> >> tmp files should be fine. >> >> do you have 2ary indexes defined? >> >> On Thu, Sep 30, 2010 at 9:23 PM, Aaron Morton >> wrote: >>> Yes, these were the tmp files in the system directory. >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:19 >>> HintsColumnFamily-tmp-e-81-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:20 >>> HintsColumnFamily-tmp-e-82-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:20 >>> HintsColumnFamily-tmp-e-82-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:30 >>> HintsColumnFamily-tmp-e-84-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 11:30 >>> HintsColumnFamily-tmp-e-84-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:30 >>> HintsColumnFamily-tmp-e-85-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:30 >>> HintsColumnFamily-tmp-e-85-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:42 >>> HintsColumnFamily-tmp-e-87-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 11:42 >>> HintsColumnFamily-tmp-e-87-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:42 >>> HintsColumnFamily-tmp-e-88-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 11:42 >>> HintsColumnFamily-tmp-e-88-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 13:07 >>> HintsColumnFamily-tmp-e-90-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 13:07 >>> HintsColumnFamily-tmp-e-90-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 13:07 >>> HintsColumnFamily-tmp-e-91-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 13:07 >>> HintsColumnFamily-tmp-e-91-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 14:58 >>> HintsColumnFamily-tmp-e-93-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 14:58 >>> HintsColumnFamily-tmp-e-93-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 14:58 >>> HintsColumnFamily-tmp-e-94-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 14:58 >>> HintsColumnFamily-tmp-e-94-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 15:05 >>> HintsColumnFamily-tmp-e-96-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 15:06 >>> HintsColumnFamily-tmp-e-96-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-01 15:06 >>> HintsColumnFamily-tmp-e-97-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-01 15:06 >>> HintsColumnFamily-tmp-e-97-Data.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A0 =A00 2010-09-03 12:05 >>> HintsColumnFamily-tmp-e-98-Index.db >>> -rw-r--r-- 1 root =A0 =A0 =A0 =A0root =A066k 2010-09-03 12:05 >>> HintsColumnFamily-tmp-e-98-Data.db >>> >>> Once I moved them out of the system dir the server would start. In the = end >>> I >>> blew away the entire system dir (see other emails today). >>> Thanks >>> Aaron >>> On 01 Oct, 2010,at 02:26 PM, Jonathan Ellis wrote: >>> >>> Do you have a zero-byte sstable somewhere? >>> >>> On Thu, Sep 30, 2010 at 5:34 PM, Aaron Morton >>> wrote: >>>> The last line in the log before the error was >>>> INFO [main] 2010-10-01 11:18:06,654 SSTableReader.java (line 162) >>>> Sampling >>>> index for >>>> /local1/junkbox/cassandra/data/system/HintsColumnFamily-tmp-e-87-<> >>>> There were several tmp files for the HintColumnFamily there. I moved t= hem >>>> and it started. >>>> I did run a nodetool drain before killing the node >>>> Aaron >>>> >>>> >>>> On 01 Oct, 2010,at 11:14 AM, Aaron Morton >>>> wrote: >>>> >>>> Am upgrading from the 0.7.0 nightly build for 31/08 to the beta 2. >>>> I've deleted the Schema* CF's in the system Keyspace and when I start = the >>>> new install I get this.. >>>> java.lang.NullPointerException >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> org.apache.cassandra.iosstable.IndexSummary.complete(IndexSummary.java= :60) >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:= 270) >>>> =A0=A0 =A0 =A0 =A0at >>>> org.apache.cassandra.io.sstable.SSTableReaderopen(SSTableReader.java:1= 73) >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> >>>> org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.jav= a:157) >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> >>>> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu= mnFamilyStore.java:334) >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> >>>> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu= mnFamilyStore.java:322) >>>> =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Table.initCf(Table.java:3= 01) >>>> =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Table.(Table.java:2= 49) >>>> =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Table.open(Table.java:102= ) >>>> =A0=A0 =A0 =A0 =A0at >>>> org.apache.cassandra.db.SystemTable.checkHealth(SystemTablejava:142) >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> >>>> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCas= sandraDaemon.java:99) >>>> =A0=A0 =A0 =A0 =A0at >>>> org.apache.cassandra.thriftCassandraDaemon.setup(CassandraDaemon.java:= 54) >>>> =A0=A0 =A0 =A0 =A0at >>>> >>>> >>>> org.apache.cassandra.service.AbstractCassandraDaemon.activate(Abstract= CassandraDaemon.java:201) >>>> =A0=A0 =A0 =A0 =A0at >>>> orgapache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:1= 33) >>>> >>>> Any thoughts ? >>>> Aaron >>>> >>> >>> >>> >>> -- >>> Jonathan Ellis >>> Project Chair, Apache Cassandra >>> co-founder of Riptano, the source for professional Cassandra support >>> http://riptano.com >>> >> >> >> >> -- >> Jonathan Ellis >> Project Chair, Apache Cassandra >> co-founder of Riptano, the source for professional Cassandra support >> http://riptano.com >> > > > > -- > Jonathan Ellis > Project Chair, Apache Cassandra > co-founder of Riptano, the source for professional Cassandra support > http://riptano.com > --=20 Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com