From cassandra-user-return-951-apmail-incubator-cassandra-user-archive=incubator.apache.org@incubator.apache.org Tue Oct 20 00:12:32 2009 Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 22299 invoked from network); 20 Oct 2009 00:12:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 20 Oct 2009 00:12:32 -0000 Received: (qmail 23589 invoked by uid 500); 20 Oct 2009 00:12:32 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 23569 invoked by uid 500); 20 Oct 2009 00:12:31 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 23560 invoked by uid 99); 20 Oct 2009 00:12:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Oct 2009 00:12:31 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of edmond@ooyala.com designates 209.85.216.183 as permitted sender) Received: from [209.85.216.183] (HELO mail-px0-f183.google.com) (209.85.216.183) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Oct 2009 00:12:23 +0000 Received: by pxi13 with SMTP id 13so3953159pxi.32 for ; Mon, 19 Oct 2009 17:12:02 -0700 (PDT) MIME-Version: 1.0 Received: by 10.142.9.32 with SMTP id 32mr360419wfi.112.1255997522195; Mon, 19 Oct 2009 17:12:02 -0700 (PDT) In-Reply-To: References: From: Edmond Lau Date: Mon, 19 Oct 2009 17:11:42 -0700 Message-ID: Subject: Re: cassandra fatal error - "The name should match the name of the current column or super column" To: cassandra-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org I wasn't able to apply the patch and reuse the old tables, but after nuking the data, I'm no longer running into the issue anymore. On Fri, Oct 16, 2009 at 3:16 PM, Jonathan Ellis wrote: > Those are both consistent with a different bug that was fixed for > 0.4.1 (now released officially!) > > -Jonathan > > On Fri, Oct 16, 2009 at 4:59 PM, Edmond Lau wrote: >> Jonathan - >> >> I patched in your latest change that dropped the assertions and tried >> to restart my cluster on my old data. =A02 of 5 nodes still failed to >> start, with different errors. >> >> One dies with a generic EOFException during recovery: >> >> INFO - Compacting >> [/var/lib/cassandra/data/Analytics/movie-53-Data.db,/var/lib/cassandra/d= ata/Analytics/movie-54-Data.db,/var/lib/cassandra/data/Analytics/movie-55-D= ata.db,/var/lib/cassandra/data/Analytics/movie-56-Data.db] >> INFO - Completed flushing Memtable(country)@1074231936 >> ERROR - Exception encountered during startup. >> java.io.EOFException >> at java.io.DataInputStream.readFully(DataInputStream.java:180) >> at java.io.DataInputStream.readUTF(DataInputStream.java:592) >> at java.io.DataInputStream.readUTF(DataInputStream.java:547) >> at org.apache.cassandra.db.RowSerializer.deserialize(Row.java:222) >> at org.apache.cassandra.db.CommitLog.recover(CommitLog.java:320) >> at org.apache.cassandra.db.RecoveryManager.doRecovery(RecoveryManager.ja= va:58) >> at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.ja= va:91) >> at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.jav= a:167) >> Exception encountered during startup. >> >> The other dies with a more interesting: >> >> =A0INFO [main] 2009-10-16 21:42:17,082 Memtable.java (line 186) Flushing >> Memtable(provider)@322343927 >> =A0INFO [main] 2009-10-16 21:42:17,179 Memtable.java (line 220) >> Completed flushing Memtable(provider)@322343927 >> ERROR [main] 2009-10-16 21:42:17,338 CassandraDaemon.java (line 185) >> Exception encountered during startup. >> java.lang.RuntimeException: Unable to load comparator class ''. >> probably this means you have obsolete sstables lying around >> =A0 =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilySerializer.readCom= parator(ColumnFamilySerializer.java:108) >> =A0 =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilySerializer.deseria= lize(ColumnFamilySerializer.java:83) >> =A0 =A0 =A0 =A0at org.apache.cassandra.db.RowSerializer.deserialize(Row.= java:229) >> =A0 =A0 =A0 =A0at org.apache.cassandra.db.CommitLog.recover(CommitLog.ja= va:320) >> =A0 =A0 =A0 =A0at org.apache.cassandra.db.RecoveryManager.doRecovery(Rec= overyManager.java:58) >> =A0 =A0 =A0 =A0at org.apache.cassandra.service.CassandraDaemon.setup(Cas= sandraDaemon.java:91) >> =A0 =A0 =A0 =A0at org.apache.cassandra.service.CassandraDaemon.main(Cass= andraDaemon.java:167) >> Caused by: java.lang.ClassNotFoundException: >> =A0 =A0 =A0 =A0at java.lang.Class.forName0(Native Method) >> =A0 =A0 =A0 =A0at java.lang.Class.forName(Class.java:169) >> =A0 =A0 =A0 =A0at org.apache.cassandra.db.ColumnFamilySerializer.readCom= parator(ColumnFamilySerializer.java:104) >> =A0 =A0 =A0 =A0... 6 more >> >> There may be some unprintable garbage characters in the class name. >> They show up in emacs but aren't visible in the system log file. >> >> Would you expect the previous fatal error to have corrupted my data? >> >> Edmond >> >> On Fri, Oct 16, 2009 at 1:23 PM, Jonathan Ellis wrot= e: >>> Don't know if you tried this yet, but Eric noticed a bug in my patch. >>> There's a new one now, fixed. >>> >>> -Jonathan >>> >> >