Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 99710 invoked from network); 4 Oct 2010 16:21:37 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 4 Oct 2010 16:21:37 -0000 Received: (qmail 16945 invoked by uid 500); 4 Oct 2010 16:21:35 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 16905 invoked by uid 500); 4 Oct 2010 16:21:35 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 16897 invoked by uid 99); 4 Oct 2010 16:21:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Oct 2010 16:21:35 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates 209.85.214.44 as permitted sender) Received: from [209.85.214.44] (HELO mail-bw0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Oct 2010 16:21:30 +0000 Received: by bwz9 with SMTP id 9so4923824bwz.31 for ; Mon, 04 Oct 2010 09:21:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=jdeQwsV7ehcPtVgCGq+bdHJZHrUHSPHjvqCYwpVKqUA=; b=WIFGbRinVj36Wxnr8t+ssKpSaRu523JFkBmYSV16md3cVZ6PB2KjvkNcPctbhwsan/ jipLSPu++gk0YDLD0xdHH/8NrysHiBtd8yAZG1zAPYLosXsyduO4ZXQzkoJdTEeaAYFO LUiM9ApQycmBPy7/ELssvpoBrgrVf5rxNmAgo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=VXiqnX3xA12SosBz1/2BeVjH/Y0isvs3QVpYbDNyAX1ypp0UmYDGH3z3f2OiklfJYa N/PF0+6qkY+Q49VxCh1ezjiX9APOe7SnzJC0cpEIsi+Bzy6dfyD0z4OZV34XZ7e6B7m6 ZV6LzQSVn2UFM85oz7aGy68yRs9rPSQezJ/cY= MIME-Version: 1.0 Received: by 10.204.112.136 with SMTP id w8mr2833676bkp.162.1286209268168; Mon, 04 Oct 2010 09:21:08 -0700 (PDT) Received: by 10.220.186.132 with HTTP; Mon, 4 Oct 2010 09:21:07 -0700 (PDT) In-Reply-To: <74f3aa15-6f20-4333-b0cd-8daedb80f33f@me.com> References: <74f3aa15-6f20-4333-b0cd-8daedb80f33f@me.com> Date: Mon, 4 Oct 2010 11:21:07 -0500 Message-ID: Subject: Re: org.apache.cassandra.db.Column cannot be cast to org.apache.cassandra.db.SuperColumn From: Jonathan Ellis To: user Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Sure looks like you changed a standard CF definition to super by mistake. On Sun, Oct 3, 2010 at 10:51 PM, Aaron Morton wro= te: > I got this error on my 0.7.0beta2 install, upgraded from the 0.70 nightly > 31/08. If you think it's just bad data let me know. > Mu cluster had some tombstone records in there, during the upgrade when I > re-added the schema I also reduced the GCGraceSeconds. I have not changed > the CF types and the system is working, the ObjectAccess CF is a super CF > and it's row and key caches are set to 0. > INFO [CompactionExecutor:1] 2010-10-04 15:38:14,508 SSTableReader.java (l= ine > 162) Sampling index for > /local1/junkbox/cassandra/data/junkbox/ObjectAccess-e-848-<> > ERROR [READ_STAGE:15] 2010-10-04 15:38:55,366 > DebuggableThreadPoolExecutor.java (line 103) Error in ThreadPoolExecutor > java.lang.ClassCastException: org.apache.cassandra.db.Column cannot be ca= st > to org.apache.cassandra.db.SuperColumn > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.removeDeletedSuper(ColumnFamily= Store.java:635) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.removeDeletedColumnsOnly(Column= FamilyStore.java:598) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.removeDeleted(ColumnFamilyStore= .java:591) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re.java:919) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re.java:886) > =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Table.getRow(Table.java:325) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.= java:63) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:71) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java= :50) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:886) > =A0=A0 =A0 =A0 =A0at > java.util.concurrentThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java= :908) > =A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:619) > =A0INFO [CompactionExecutor:1] 2010-10-04 15:38:55,394 SSTableReader.java > (line 162) Sampling index for > /local1/junkbox/cassandra/data/junkbox/ObjectAccess-e-849-<> > ERROR [READ_STAGE:15] 2010-10-04 15:38:55,405 AbstractCassandraDaemon.jav= a > (line 88) Fatal exception in thread Thread[READ_STAGE:15,5,main] > java.lang.ClassCastException: org.apache.cassandra.db.Column cannot be ca= st > to org.apache.cassandra.db.SuperColumn > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.removeDeletedSuper(ColumnFamily= Store.java:635) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.removeDeletedColumnsOnly(Column= FamilyStore.java:598) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.removeDeleted(ColumnFamilyStore= .java:591) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re.java:919) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto= re.java:886) > =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Table.getRow(Table.java:325) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.= java:63) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:71) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java= :50) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:886) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:908) > =A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:619) > > There were then a number =A0"This operation not supported for Super Colum= ns" > errors. Don't think they are related, including them for=A0completeness. > =A0INFO [Thread-614] 2010-10-04 15:39:01,346 StreamInSession.java (line 1= 58) > Finished streaming session 5350649304261310 from /192.168.34.26 > =A0INFO [Thread-614] 2010-10-04 15:39:01,346 AntiEntropyService.java (lin= e > 557) Finished streaming repair for # manual-repair-b6e5498f-9864-4a3d-94f8-42e3c631f4e4, /192.168.34.26, > (junkbox,Objects)> > =A0INFO [Thread-614] 2010-10-04 15:39:01,346 AntiEntropyService.java (lin= e > 828) # /192.168.34.26, (junkbox,Objects)> completed successfully: 3 outstanding. > =A0INFO [CompactionExecutor:1] 2010-10-04 15:39:01,347 CompactionManager.= java > (line 233) Compacting > [org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/ca= ssandra/data/junkbox/ObjectIndex-e-819-Data.db'),org.apache.cassandra.io.ss= table.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIn= dex-e-826-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/= local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-827-Data.db'),org.apach= e.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data= /junkbox/BucketAccess-e-830-Data.db'),org.apache.cassandra.io.sstable.SSTab= leReader(path=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-838-= Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/jun= kbox/cassandra/data/junkbox/BucketAccess-e-841-Data.db'),org.apachecassandr= a.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/O= bjectIndex-e-849-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(pa= th=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-860-Data.db')] > ERROR [CompactionExecutor:1] 2010-10-04 15:39:01,817 > AbstractCassandraDaemon.java (line 88) Fatal exception in thread > Thread[CompactionExecutor:1,1,main] > java.lang.UnsupportedOperationException: This operation is not supported = for > Super Columns. > =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.SuperColumn.clock(SuperColum= n.java:149) > =A0=A0 =A0 =A0 =A0at > org.apachecassandra.db.ColumnSerializer.serialize(ColumnSerializer.java:5= 5) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnSerializer.serialize(ColumnSerializer.java:= 31) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilySerializer.serializeForSSTable(Column= FamilySerializer.java:82) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.ColumnFamilySerializer.serializeWithIndexes(Colum= nFamilySerializer.java:102) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.io.PrecompactedRow.(PrecompactedRow.java:96) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIter= ator.java:138) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.= java:107) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.= java:42) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.= java:73) > =A0=A0 =A0 =A0 =A0at > com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractItera= tor.java:136) > =A0=A0 =A0 =A0 =A0at > com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:= 131) > =A0=A0 =A0 =A0 =A0at > org.apache.commons.collections.iterators.FilterIterator.setNextObject(Fil= terIterator.java:183) > =A0=A0 =A0 =A0 =A0at > org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIte= rator.java:94) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.= java:282) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:1= 06) > =A0=A0 =A0 =A0 =A0at > org.apache.cassandra.db.CompactionManager$1call(CompactionManager.java:84= ) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > =A0=A0 =A0 =A0 =A0at java.util.concurrent.FutureTask.run(FutureTask.java:= 138) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor= .java:886) > =A0=A0 =A0 =A0 =A0at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.jav= a:908) > =A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:619) > =A0INFO [CompactionExecutor:1] 2010-10-04 15:39:01,819 CompactionManager.= java > (line 233) Compacting > [org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/ca= ssandra/data/junkbox/ObjectIndex-e-819-Data.db'),org.apache.cassandra.io.ss= table.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIn= dex-e-826-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/= local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-827-Data.db'),org.apach= e.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data= /junkbox/BucketAccess-e-830-Data.db'),org.apache.cassandra.io.sstable.SSTab= leReader(path=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-838-= Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/jun= kbox/cassandra/data/junkbox/BucketAccess-e-841-Data.db'),org.apache.cassand= ra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/= ObjectIndex-e-849-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(p= ath=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-860-Data.db')] > > > I've restarted that node with DEBUG logging to see if it happens again an= d > if I can get more info. A major compaction is running now. Not sure how t= o > go about reproducing the fault. > Thanks > Aaron > > > --=20 Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com