Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 36192 invoked from network); 4 Oct 2010 03:52:27 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 4 Oct 2010 03:52:27 -0000 Received: (qmail 1899 invoked by uid 500); 4 Oct 2010 03:52:25 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 1746 invoked by uid 500); 4 Oct 2010 03:52:22 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 1738 invoked by uid 99); 4 Oct 2010 03:52:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Oct 2010 03:52:21 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,MIME_QP_LONG_LINE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a51.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Oct 2010 03:52:12 +0000 Received: from homiemail-a51.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a51.g.dreamhost.com (Postfix) with ESMTP id 29F372E806D for ; Sun, 3 Oct 2010 20:51:49 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; c=nofws; d=thelastpickle.com; h=to:from :subject:date:message-id:content-type:mime-version; q=dns; s= thelastpickle.com; b=3M1ZJPePqdIhNU8eziFWFWvirHQKPH5/yydtfIcsa3k ElbA8xBAYpWcjvBTduPW7FharYIp7sh5Q4fL4EsUMbjhYJZb+kTkDvGyrLotnXmX yyZxmAh0VFGJO+SFG9XaPCjOewPTCLne3maGcb+1CFXCONs/stsBD9JaB1nSjW4o = DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=to :from:subject:date:message-id:content-type:mime-version; s= thelastpickle.com; bh=o4BDgARQTIpSmVhG9xHw+6hKCw4=; b=sddBwh6ub7 zIcV0yhbySYE6cUdzjt+KNqYKWox4KBR6RtITbUbz0gSl7Sby98e183cFwQD9ZwS 7xTfyI+e86xjbtjkShiMhJ9JFu8FsP0le2W+6hbM+ovDnCnKQHwHCvQ+M1Fubc4E WpL24H414D0VpqpYptIssd0BcyIdrcT80= Received: from localhost (webms.mac.com [17.148.16.116]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a51.g.dreamhost.com (Postfix) with ESMTPSA id 18EC02E806A for ; Sun, 3 Oct 2010 20:51:49 -0700 (PDT) To: Cassandra User From: Aaron Morton Subject: org.apache.cassandra.db.Column cannot be cast to org.apache.cassandra.db.SuperColumn Date: Mon, 04 Oct 2010 03:51:47 GMT X-Mailer: MobileMe Mail (1C3203) Message-id: <74f3aa15-6f20-4333-b0cd-8daedb80f33f@me.com> Content-Type: multipart/alternative; boundary=Apple-Webmail-42--bd993b14-0541-6b1b-af90-edbb55f001e1 MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Webmail-42--bd993b14-0541-6b1b-af90-edbb55f001e1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=ISO-8859-1; format=flowed I got this error on my 0.7.0beta2 install, upgraded from the 0.7.0 nightly= 31/08. If you think it's just bad data let me know.=A0=0A=0AMu cluster ha= d some tombstone records in there, during the upgrade when I re-added the = schema I also reduced the GCGraceSeconds. I have not changed the CF types = and the system is working, the ObjectAccess CF is a super CF and it's row = and key caches are set to 0.=A0=0A=0AINFO [CompactionExecutor:1] 2010-10-0= 4 15:38:14,508 SSTableReader.java (line 162) Sampling index for /local1/ju= nkbox/cassandra/data/junkbox/ObjectAccess-e-848-<>=0AERROR [READ_STAGE:15]= 2010-10-04 15:38:55,366 DebuggableThreadPoolExecutor.java (line 103) Erro= r in ThreadPoolExecutor=0Ajava.lang.ClassCastException: org.apache.cassand= ra.db.Column cannot be cast to org.apache.cassandra.db.SuperColumn=0A=A0=A0= =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilyStore.removeDeletedSupe= r(ColumnFamilyStore.java:635)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.= db.ColumnFamilyStore.removeDeletedColumnsOnly(ColumnFamilyStore.java:598)=0A= =A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilyStore.removeDelet= ed(ColumnFamilyStore.java:591)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra= db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:919)=0A=A0=A0= =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(C= olumnFamilyStore.java:886)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.= Table.getRow(Table.java:325)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.d= b.SliceFromReadCommand.getRow(SliceFromReadCommand.java:63)=0A=A0=A0 =A0 =A0= =A0at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java= :71)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.net.MessageDeliveryTask.r= un(MessageDeliveryTask.java:50)=0A=A0=A0 =A0 =A0 =A0at java.util.concurren= t.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)=0A=A0=A0 = =A0 =A0 =A0at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo= lExecutor.java:908)=0A=A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.jav= a:619)=0A=A0INFO [CompactionExecutor:1] 2010-10-04 15:38:55,394 SSTableRea= der.java (line 162) Sampling index for /local1/junkbox/cassandra/data/junk= box/ObjectAccess-e-849-<>=0AERROR [READ_STAGE:15] 2010-10-04 15:38:55,405 = AbstractCassandraDaemon.java (line 88) Fatal exception in thread Thread[RE= AD_STAGE:15,5,main]=0Ajava.lang.ClassCastException: org.apache.cassandra.d= b.Column cannot be cast to org.apache.cassandra.db.SuperColumn=0A=A0=A0 =A0= =A0 =A0at org.apache.cassandra.db.ColumnFamilyStore.removeDeletedSuper(Co= lumnFamilyStore.java:635)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.C= olumnFamilyStore.removeDeletedColumnsOnly(ColumnFamilyStore.java:598)=0A=A0= =A0 =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilyStore.removeDeleted(= ColumnFamilyStore.java:591)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db= ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:919)=0A=A0=A0 =A0= =A0 =A0at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(Colum= nFamilyStore.java:886)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Tabl= e.getRow(Table.java:325)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.Sl= iceFromReadCommand.getRow(SliceFromReadCommand.java:63)=0A=A0=A0 =A0 =A0 =A0= at org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:71)= =0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.net.MessageDeliveryTask.run(M= essageDeliveryTask.java:50)=0A=A0=A0 =A0 =A0 =A0at java.util.concurrent.Th= readPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)=0A=A0=A0 =A0 = =A0 =A0at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExe= cutor.java:908)=0A=A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.java:61= 9)=0A=0A=0AThere were then a number =A0"This operation not supported for S= uper Columns" errors. Don't think they are related, including them for=A0c= ompleteness.=A0=0A=0A=A0INFO [Thread-614] 2010-10-04 15:39:01,346 StreamIn= Session.java (line 158) Finished streaming session 5350649304261310 from /= 192.168.34.26=0A=A0INFO [Thread-614] 2010-10-04 15:39:01,346 AntiEntropySe= rvice.java (line 557) Finished streaming repair for #=0A=A0INFO [Thread-614] 2010-10-04 15:39:01,346 AntiEntropyService.jav= a (line 828) # completed successfully: 3 outstand= ing.=0A=A0INFO [CompactionExecutor:1] 2010-10-04 15:39:01,347 CompactionMa= nager.java (line 233) Compacting [org.apache.cassandra.io.sstable.SSTableR= eader(path=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-819-Dat= a.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkb= ox/cassandra/data/junkbox/ObjectIndex-e-826-Data.db'),org.apache.cassandra= io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/O= bjectIndex-e-827-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(p= ath=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-830-Data.db')= ,org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cas= sandra/data/junkbox/BucketAccess-e-838-Data.db'),org.apache.cassandra.io.s= stable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/Bucket= Access-e-841-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D= '/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-849-Data.db'),org.ap= ache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/= data/junkbox/BucketAccess-e-860-Data.db')]=0AERROR [CompactionExecutor:1] = 2010-10-04 15:39:01,817 AbstractCassandraDaemon.java (line 88) Fatal excep= tion in thread Thread[CompactionExecutor:1,1,main]=0Ajava.lang.Unsupported= OperationException: This operation is not supported for Super Columns.=0A=A0= =A0 =A0 =A0 =A0at org.apache.cassandra.db.SuperColumn.clock(SuperColumn.ja= va:149)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.ColumnSerializer.se= rialize(ColumnSerializer.java:55)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassan= dra.db.ColumnSerializer.serialize(ColumnSerializer.java:31)=0A=A0=A0 =A0 =A0= =A0at org.apache.cassandra.db.ColumnFamilySerializer.serializeForSSTable(= ColumnFamilySerializer.java:82)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandr= a.db.ColumnFamilySerializer.serializeWithIndexes(ColumnFamilySerializer.ja= va:102)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.io.PrecompactedRow.(PrecompactedRow.java:96)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.i= o.CompactionIterator.getCompactedRow(CompactionIterator.java:138)=0A=A0=A0= =A0 =A0 =A0at org.apache.cassandra.io.CompactionIterator.getReduced(Compa= ctionIterator.java:107)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.io.Com= pactionIterator.getReduced(CompactionIterator.java:42)=0A=A0=A0 =A0 =A0 =A0= at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterato= r.java:73)=0A=A0=A0 =A0 =A0 =A0at com.google.common.collect.AbstractIterat= or.tryToComputeNext(AbstractIterator.java:136)=0A=A0=A0 =A0 =A0 =A0at com.= google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131)=0A= =A0=A0 =A0 =A0 =A0at org.apache.commons.collections.iterators.FilterIterat= or.setNextObject(FilterIterator.java:183)=0A=A0=A0 =A0 =A0 =A0at org.apach= e.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java= :94)=0A=A0=A0 =A0 =A0 =A0at org.apache.cassandra.db.CompactionManager.doCo= mpaction(CompactionManager.java:282)=0A=A0=A0 =A0 =A0 =A0at org.apache.cas= sandra.db.CompactionManager$1.call(CompactionManager.java:106)=0A=A0=A0 =A0= =A0 =A0at org.apache.cassandra.db.CompactionManager$1.call(CompactionMana= ger.java:84)=0A=A0=A0 =A0 =A0 =A0at java.util.concurrent.FutureTask$Sync.i= nnerRun(FutureTask.java:303)=0A=A0=A0 =A0 =A0 =A0at java.util.concurrent.F= utureTask.run(FutureTask.java:138)=0A=A0=A0 =A0 =A0 =A0at java.util.concur= rent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)=0A=A0=A0= =A0 =A0 =A0at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo= olExecutor.java:908)=0A=A0=A0 =A0 =A0 =A0at java.lang.Thread.run(Thread.ja= va:619)=0A=A0INFO [CompactionExecutor:1] 2010-10-04 15:39:01,819 Compactio= nManager.java (line 233) Compacting [org.apache.cassandra.io.sstable.SSTab= leReader(path=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-819-= Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/ju= nkbox/cassandra/data/junkbox/ObjectIndex-e-826-Data.db'),org.apache.cassan= dra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbo= x/ObjectIndex-e-827-Data.db'),org.apache.cassandra.io.sstable.SSTableReade= r(path=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-830-Data.d= b'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/= cassandra/data/junkbox/BucketAccess-e-838-Data.db'),org.apache.cassandra.i= o.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/Buc= ketAccess-e-841-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(pa= th=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-849-Data.db'),o= rg.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassa= ndra/data/junkbox/BucketAccess-e-860-Data.db')]=0A=0A=0A=0AI've restarted = that node with DEBUG logging to see if it happens again and if I can get m= ore info. A major compaction is running now. Not sure how to go about repr= oducing the fault.=A0=0A=0AThanks=0AAaron=0A=0A=0A=0A --Apple-Webmail-42--bd993b14-0541-6b1b-af90-edbb55f001e1 Content-Type: multipart/related; type="text/html"; boundary=Apple-Webmail-86--bd993b14-0541-6b1b-af90-edbb55f001e1 --Apple-Webmail-86--bd993b14-0541-6b1b-af90-edbb55f001e1 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=ISO-8859-1;
I got this error on my 0.7.0beta2 install, upgraded from the 0.7= 0 nightly 31/08. If you think it's just bad data let me know. 
=

Mu cluster had some tombstone records in there, during= the upgrade when I re-added the schema I also reduced the GCGraceSeconds.= I have not changed the CF types and the system is working, the ObjectAcce= ss CF is a super CF and it's row and key caches are set to 0. 
<= div>
INFO [CompactionExecutor:1] 2010-10-04 15:38:14,508 SST= ableReader.java (line 162) Sampling index for /local1/junkbox/cassandra/da= ta/junkbox/ObjectAccess-e-848-<>
ERROR [READ_STAGE:15] 201= 0-10-04 15:38:55,366 DebuggableThreadPoolExecutor.java (line 103) Error in= ThreadPoolExecutor
java.lang.ClassCastException: org.apache.cas= sandra.db.Column cannot be cast to org.apache.cassandra.db.SuperColumn
        at org.apache.cassandra.db.ColumnF= amilyStore.removeDeletedSuper(ColumnFamilyStore.java:635)
 =        at org.apache.cassandra.db.ColumnFamilyStore.re= moveDeletedColumnsOnly(ColumnFamilyStore.java:598)
   =      at org.apache.cassandra.db.ColumnFamilyStore.removeDel= eted(ColumnFamilyStore.java:591)
       &nbs= p;at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamil= yStore.java:919)
        at org.apache.= cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:886)=
        at org.apache.cassandra.db.Tab= le.getRow(Table.java:325)
        at or= g.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.jav= a:63)
        at org.apache.cassandra.d= b.ReadVerbHandler.doVerb(ReadVerbHandler.java:71)
   &= nbsp;    at org.apache.cassandra.net.MessageDeliveryTask.run(Mes= sageDeliveryTask.java:50)
        at ja= va.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.ja= va:886)
        at java.util.concurrent= ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
&nbs= p;       at java.lang.Thread.run(Thread.java:619)
 INFO [CompactionExecutor:1] 2010-10-04 15:38:55,394 SSTableRea= der.java (line 162) Sampling index for /local1/junkbox/cassandra/data/junk= box/ObjectAccess-e-849-<>
ERROR [READ_STAGE:15] 2010-10-04= 15:38:55,405 AbstractCassandraDaemon.java (line 88) Fatal exception in th= read Thread[READ_STAGE:15,5,main]
java.lang.ClassCastException: = org.apache.cassandra.db.Column cannot be cast to org.apache.cassandra.db.S= uperColumn
        at org.apache.cassan= dra.db.ColumnFamilyStore.removeDeletedSuper(ColumnFamilyStore.java:635)
        at org.apache.cassandra.db.Column= FamilyStore.removeDeletedColumnsOnly(ColumnFamilyStore.java:598)
        at org.apache.cassandra.db.ColumnFamilyS= tore.removeDeleted(ColumnFamilyStore.java:591)
   &nbs= p;    at org.apache.cassandra.db.ColumnFamilyStore.getColumnFami= ly(ColumnFamilyStore.java:919)
        = at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyS= tore.java:886)
        at org.apache.ca= ssandra.db.Table.getRow(Table.java:325)
     &nbs= p;  at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromR= eadCommand.java:63)
        at org.apac= he.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:71)
=         at org.apache.cassandra.net.MessageDelive= ryTask.run(MessageDeliveryTask.java:50)
     &nbs= p;  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadP= oolExecutor.java:886)
        at java.u= til.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<= /div>
        at java.lang.Thread.run(Thread.= java:619)


There were then a number =  "This operation not supported for Super Columns" errors. Don't think= they are related, including them for completeness. 
<= br>
 INFO [Thread-614] 2010-10-04 15:39:01,346 StreamInSess= ion.java (line 158) Finished streaming session 5350649304261310 from /192.= 168.34.26
 INFO [Thread-614] 2010-10-04 15:39:01,346 AntiEn= tropyService.java (line 557) Finished streaming repair for #<TreeReques= t manual-repair-b6e5498f-9864-4a3d-94f8-42e3c631f4e4, /192.168.34.26, (jun= kbox,Objects)>
 INFO [Thread-614] 2010-10-04 15:39:01,34= 6 AntiEntropyService.java (line 828) #<TreeRequest manual-repair-b6e549= 8f-9864-4a3d-94f8-42e3c631f4e4, /192.168.34.26, (junkbox,Objects)> comp= leted successfully: 3 outstanding.
 INFO [CompactionExecuto= r:1] 2010-10-04 15:39:01,347 CompactionManager.java (line 233) Compacting = [org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cas= sandra/data/junkbox/ObjectIndex-e-819-Data.db'),org.apache.cassandra.io.ss= table.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/ObjectI= ndex-e-826-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D= '/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-827-Data.db'),org.ap= ache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/= data/junkbox/BucketAccess-e-830-Data.db'),org.apache.cassandra.io.sstable.= SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-= e-838-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/loc= al1/junkbox/cassandra/data/junkbox/BucketAccess-e-841-Data.db'),org.apache= cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data= /junkbox/ObjectIndex-e-849-Data.db'),org.apache.cassandra.io.sstable.SSTab= leReader(path=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-860= -Data.db')]
ERROR [CompactionExecutor:1] 2010-10-04 15:39:01,817= AbstractCassandraDaemon.java (line 88) Fatal exception in thread Thread[C= ompactionExecutor:1,1,main]
java.lang.UnsupportedOperationExcept= ion: This operation is not supported for Super Columns.
 &n= bsp;      at org.apache.cassandra.db.SuperColumn.clock(Supe= rColumn.java:149)
        at org.apache= cassandra.db.ColumnSerializer.serialize(ColumnSerializer.java:55)
        at org.apache.cassandra.db.ColumnSeria= lizer.serialize(ColumnSerializer.java:31)
     &n= bsp;  at org.apache.cassandra.db.ColumnFamilySerializer.serializeForS= STable(ColumnFamilySerializer.java:82)
      = ;  at org.apache.cassandra.db.ColumnFamilySerializer.serializeWithInd= exes(ColumnFamilySerializer.java:102)
      =  at org.apache.cassandra.io.PrecompactedRow.<init>(Precompacte= dRow.java:96)
        at org.apache.cas= sandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:138)<= /div>
        at org.apache.cassandra.io.Comp= actionIterator.getReduced(CompactionIterator.java:107)
 &nb= sp;      at org.apache.cassandra.io.CompactionIterator.getR= educed(CompactionIterator.java:42)
       &n= bsp;at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIte= rator.java:73)
        at com.google.co= mmon.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136)<= /div>
        at com.google.common.collect.Ab= stractIterator.hasNext(AbstractIterator.java:131)
   &= nbsp;    at org.apache.commons.collections.iterators.FilterItera= tor.setNextObject(FilterIterator.java:183)
     &= nbsp;  at org.apache.commons.collections.iterators.FilterIterator.has= Next(FilterIterator.java:94)
        at= org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.= java:282)
        at org.apache.cassand= ra.db.CompactionManager$1.call(CompactionManager.java:106)
 = ;       at org.apache.cassandra.db.CompactionManager$1= call(CompactionManager.java:84)
       &nbs= p;at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTas= k.run(FutureTask.java:138)
        at j= ava.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.j= ava:886)
        at java.util.concurren= t.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
&nb= sp;       at java.lang.Thread.run(Thread.java:619)
 INFO [CompactionExecutor:1] 2010-10-04 15:39:01,819 Compactio= nManager.java (line 233) Compacting [org.apache.cassandra.io.sstable.SSTab= leReader(path=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-819-= Data.db'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/ju= nkbox/cassandra/data/junkbox/ObjectIndex-e-826-Data.db'),org.apache.cassan= dra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbo= x/ObjectIndex-e-827-Data.db'),org.apache.cassandra.io.sstable.SSTableReade= r(path=3D'/local1/junkbox/cassandra/data/junkbox/BucketAccess-e-830-Data.d= b'),org.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/= cassandra/data/junkbox/BucketAccess-e-838-Data.db'),org.apache.cassandra.i= o.sstable.SSTableReader(path=3D'/local1/junkbox/cassandra/data/junkbox/Buc= ketAccess-e-841-Data.db'),org.apache.cassandra.io.sstable.SSTableReader(pa= th=3D'/local1/junkbox/cassandra/data/junkbox/ObjectIndex-e-849-Data.db'),o= rg.apache.cassandra.io.sstable.SSTableReader(path=3D'/local1/junkbox/cassa= ndra/data/junkbox/BucketAccess-e-860-Data.db')]

=


I've restarted that node with DEBUG log= ging to see if it happens again and if I can get more info. A major compac= tion is running now. Not sure how to go about reproducing the fault. =

Thanks
Aaron

=

--Apple-Webmail-86--bd993b14-0541-6b1b-af90-edbb55f001e1-- --Apple-Webmail-42--bd993b14-0541-6b1b-af90-edbb55f001e1--