Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates
 209.85.215.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <4E51F454.6010107@mebigfatguy.com>
References: 
 <CAOA66tHts4nBzsdD3uUSTm22V83wZVJr4xZBRCayMkj6TSWnyA@mail.gmail.com>
 <CALdd-zi5gKgrjpXB_qnF7fsnQiqiOuE25vg_ECChYDzJGQNk2Q@mail.gmail.com>
 <4E51F454.6010107@mebigfatguy.com>
From: Jonathan Ellis <jbellis@gmail.com>
Date: Mon, 22 Aug 2011 10:09:01 -0500
Message-ID: 
 <CALdd-zi5eW-nACD6LU8svx_aVm50f5NRjkR0A60Zq4vHtdQOLg@mail.gmail.com>
Subject: Re: Recover from startup problems
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Yes, you can blow away both the data and commitlog directories and
restart, but can you try these first to troubleshoot?

1. make a copy of the commitlog directory
2. downgrade to 0.8 with no other changes, to see if it's something on
the new read path
2a. if 0.8 starts up then we will fix the read code in trunk
2b. if 0.8 doesn't start up either, remove the data directory but NOT
commitlog, and restart.  this will cause commitlog to be replayed --
with luck whatever is causing the problem is still in there, so if it
breaks again, we have a reproducible case

Thanks!

On Mon, Aug 22, 2011 at 1:16 AM, Dave Brosius <dbrosius@mebigfatguy.com> wr=
ote:
> Greetings, I'm running head from source, and now when i try to start up t=
he
> database, i get the following exception which causes client connection
> failures. I'm fine with blowing away the database, just playing, but want=
ed
> to know if there is a safe way to do this.
>
> Exception encountered during startup.
> java.lang.RuntimeException: error reading 1 of 3
> =A0 =A0at
> org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(Simp=
leSliceReader.java:83)
> =A0 =A0at
> org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(Simp=
leSliceReader.java:40)
> =A0 =A0at
> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractItera=
tor.java:140)
> =A0 =A0at
> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:=
135)
> =A0 =A0at
> org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTab=
leSliceIterator.java:107)
> =A0 =A0at
> org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.=
java:194)
> =A0 =A0at org.apache.cassandra.utils.MergeIterator.<init>(MergeIterator.j=
ava:47)
> =A0 =A0at
> org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator.j=
ava:142)
> =A0 =A0at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.java=
:66)
> =A0 =A0at
> org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.jav=
a:96)
> =A0 =A0at
> org.apache.cassandra.db.CollationController.collectAllData(CollationContr=
oller.java:221)
> =A0 =A0at
> org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationC=
ontroller.java:63)
> =A0 =A0at
> org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamily=
Store.java:1285)
> =A0 =A0at
> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto=
re.java:1169)
> =A0 =A0at
> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilySto=
re.java:1120)
> =A0 =A0at org.apache.cassandra.db.DefsTable.loadFromStorage(DefsTable.jav=
a:83)
> =A0 =A0at
> org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDescri=
ptor.java:507)
> =A0 =A0at
> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassan=
draDaemon.java:159)
> =A0 =A0at
> org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCas=
sandraDaemon.java:335)
> =A0 =A0at
> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:91)
> Caused by: java.nio.channels.ClosedChannelException
> =A0 =A0at
> org.apache.cassandra.io.util.RandomAccessReader.read(RandomAccessReader.j=
ava:268)
> =A0 =A0at java.io.RandomAccessFile.readByte(RandomAccessFile.java:589)
> =A0 =A0at
> org.apache.cassandra.utils.ByteBufferUtil.readShortLength(ByteBufferUtil.=
java:356)
> =A0 =A0at
> org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferU=
til.java:367)
> =A0 =A0at
> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.jav=
a:87)
> =A0 =A0at
> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.jav=
a:82)
> =A0 =A0at
> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.jav=
a:72)
> =A0 =A0at
> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.jav=
a:36)
> =A0 =A0at
> org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(Simp=
leSliceReader.java:79)
>


--=20
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com