Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates
 209.85.215.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <4E531B03.3090006@mebigfatguy.com>
References: 
 <CAOA66tHts4nBzsdD3uUSTm22V83wZVJr4xZBRCayMkj6TSWnyA@mail.gmail.com>
 <CALdd-zi5gKgrjpXB_qnF7fsnQiqiOuE25vg_ECChYDzJGQNk2Q@mail.gmail.com>
 <4E51F454.6010107@mebigfatguy.com>
 <CALdd-zi5eW-nACD6LU8svx_aVm50f5NRjkR0A60Zq4vHtdQOLg@mail.gmail.com>
 <4E531B03.3090006@mebigfatguy.com>
From: Jonathan Ellis <jbellis@gmail.com>
Date: Mon, 22 Aug 2011 22:24:48 -0500
Message-ID: 
 <CALdd-zgubK8NYQqaAFxLWFVEVvrkXMMxAxC=Uae1T7Omu6SCnA@mail.gmail.com>
Subject: Re: Recover from startup problems
To: user@cassandra.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

It's erroring out trying to load the schema itself, though, which
isn't supposed to happen.

On Mon, Aug 22, 2011 at 10:14 PM, Dave Brosius <dbrosius@mebigfatguy.com> w=
rote:
> Sure i'll try that, but I'm pretty sure it was creating a column family
> without any column meta data (types), then, client.insert'ing a ByteBuffe=
r
> that wasn't based on bytes from a String.getBytes call.
>
>
>
> On 08/22/2011 11:09 AM, Jonathan Ellis wrote:
>>
>> Yes, you can blow away both the data and commitlog directories and
>> restart, but can you try these first to troubleshoot?
>>
>> 1. make a copy of the commitlog directory
>> 2. downgrade to 0.8 with no other changes, to see if it's something on
>> the new read path
>> 2a. if 0.8 starts up then we will fix the read code in trunk
>> 2b. if 0.8 doesn't start up either, remove the data directory but NOT
>> commitlog, and restart. =A0this will cause commitlog to be replayed --
>> with luck whatever is causing the problem is still in there, so if it
>> breaks again, we have a reproducible case
>>
>> Thanks!
>>
>> On Mon, Aug 22, 2011 at 1:16 AM, Dave Brosius<dbrosius@mebigfatguy.com>
>> =A0wrote:
>>>
>>> Greetings, I'm running head from source, and now when i try to start up
>>> the
>>> database, i get the following exception which causes client connection
>>> failures. I'm fine with blowing away the database, just playing, but
>>> wanted
>>> to know if there is a safe way to do this.
>>>
>>> Exception encountered during startup.
>>> java.lang.RuntimeException: error reading 1 of 3
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(Si=
mpleSliceReader.java:83)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(Si=
mpleSliceReader.java:40)
>>> =A0 =A0at
>>>
>>> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIte=
rator.java:140)
>>> =A0 =A0at
>>>
>>> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.jav=
a:135)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SST=
ableSliceIterator.java:107)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterato=
r.java:194)
>>> =A0 =A0at
>>> org.apache.cassandra.utils.MergeIterator.<init>(MergeIterator.java:47)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.utils.MergeIterator$ManyToOne.<init>(MergeIterator=
.java:142)
>>> =A0 =A0at org.apache.cassandra.utils.MergeIterator.get(MergeIterator.ja=
va:66)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.j=
ava:96)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.CollationController.collectAllData(CollationCon=
troller.java:221)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.CollationController.getTopLevelColumns(Collatio=
nController.java:63)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFami=
lyStore.java:1285)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyS=
tore.java:1169)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyS=
tore.java:1120)
>>> =A0 =A0at
>>> org.apache.cassandra.db.DefsTable.loadFromStorage(DefsTable.java:83)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.config.DatabaseDescriptor.loadSchemas(DatabaseDesc=
riptor.java:507)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCass=
andraDaemon.java:159)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractC=
assandraDaemon.java:335)
>>> =A0 =A0at
>>> org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:9=
1)
>>> Caused by: java.nio.channels.ClosedChannelException
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.io.util.RandomAccessReader.read(RandomAccessReader=
.java:268)
>>> =A0 =A0at java.io.RandomAccessFile.readByte(RandomAccessFile.java:589)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.utils.ByteBufferUtil.readShortLength(ByteBufferUti=
l.java:356)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBuffe=
rUtil.java:367)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.j=
ava:87)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.j=
ava:82)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.j=
ava:72)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.j=
ava:36)
>>> =A0 =A0at
>>>
>>> org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(Si=
mpleSliceReader.java:79)
>>>
>>
>>
>
>


--=20
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com