Return-Path: 
 <user-return-16496-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org>
X-Original-To: apmail-cassandra-user-archive@www.apache.org
Delivered-To: apmail-cassandra-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id AB1522B51
	for <apmail-cassandra-user-archive@www.apache.org>;
 Thu,  5 May 2011 20:07:26 +0000 (UTC)
Received: (qmail 63553 invoked by uid 500); 5 May 2011 20:07:24 -0000
Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org
Received: (qmail 63511 invoked by uid 500); 5 May 2011 20:07:24 -0000
Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@cassandra.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@cassandra.apache.org>
List-Post: <mailto:user@cassandra.apache.org>
List-Id: <user.cassandra.apache.org>
Reply-To: user@cassandra.apache.org
Delivered-To: mailing list user@cassandra.apache.org
Received: (qmail 63503 invoked by uid 99); 5 May 2011 20:07:24 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 May 2011 20:07:24 +0000
X-ASF-Spam-Status: No, hits=2.2 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL
X-Spam-Check-By: apache.org
Received-SPF: neutral (athena.apache.org: local policy)
Received: from [209.85.216.44] (HELO mail-qw0-f44.google.com) (209.85.216.44)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 May 2011 20:07:19 +0000
Received: by qwc23 with SMTP id 23so2144089qwc.31
        for <user@cassandra.apache.org>; Thu, 05 May 2011 13:06:57 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.52.72.232 with SMTP id g8mr3656881vdv.160.1304626017706; Thu,
 05 May 2011 13:06:57 -0700 (PDT)
Received: by 10.220.185.139 with HTTP; Thu, 5 May 2011 13:06:57 -0700 (PDT)
X-Originating-IP: [69.200.243.125]
In-Reply-To: <BANLkTin=BtE1exU-gFCyGBOo56r2QyUj4Q@mail.gmail.com>
References: <BANLkTinjrbON_J6mmXM9u5KbAMp+Wa4vCg@mail.gmail.com>
	<BANLkTin=BtE1exU-gFCyGBOo56r2QyUj4Q@mail.gmail.com>
Date: Thu, 5 May 2011 16:06:57 -0400
Message-ID: <BANLkTimGQMYPdvyWGa6-B76MB8fRDmR7nQ@mail.gmail.com>
Subject: Re: estimateRowsFromIndex exception in 0.7.5
From: Wenjun Che <wenjun@openf.in>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=bcaec501608b59a44804a28cea99

--bcaec501608b59a44804a28cea99
Content-Type: text/plain; charset=ISO-8859-1

Sylvain, thanks for the quick response, and you are correct: there is an
empty index file.  I removed the file and tried to start it up.  Now
Cassandra is reporting corrupt sstables.  Does this mean I can't just simply
back up var/lib directory (use snapshots instead) ? We don't have much data
right now so I thought it'd be easier to back up the entire directory.

Thanks

On Thu, May 5, 2011 at 2:56 PM, Sylvain Lebresne <sylvain@datastax.com>wrote:

> On Thu, May 5, 2011 at 8:38 PM, Wenjun Che <wenjun@openf.in> wrote:
> > Hello,
> >
> > I have a one node cluster (refresh install from 0.7.4 and upgraded to
> 0.7.5
> > last week).  The data is being backed up by  a cron job that periodically
> > tar/gzip entire
> > var/lib directory.  when I tested the backup by restoring the last tar
> file,
> > I am seeing the following exception:
> >
> > DEBUG 13:45:37,830 Load statistics for
> > \var\lib\cassandra\data\Appoji\ApplicationUserPermission-f-6
> > ERROR 13:45:37,832 Exception encountered during startup.
> > java.lang.AssertionError
> >         at
> >
> org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.java:233)
> >         at
> >
> org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:286)
> >         at
> >
> org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:191)
> >         at
> >
> org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:232)
> >         at
> >
> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:
> > 480)
> >         at
> >
> org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:
> > 461)
> >         at org.apache.cassandra.db.Table.initCf(Table.java:308)
> >         at org.apache.cassandra.db.Table.<init>(Table.java:245)
> >         at org.apache.cassandra.db.Table.open(Table.java:106)
> >         at
> >
> org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:1
> > 61)
> >         at
> >
> org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.jav
> > a:315)
> >         at
> > org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> > Exception encountered during startup.
> >
> > I checked few other earlier backup tar files and they seem to be fine.
> Can
> > this be caused by the way I am backing  it up?
>
> I think that could be triggered if you have a 0 bytes index file for
> instance, so if you had one such
> index file in the backup, that could be a problem.
>
> --
> Sylvain
>

--bcaec501608b59a44804a28cea99
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Sylvain, thanks for the quick response, and you are correct: there is an em=
pty index file.=A0 I removed the file and tried to start it up.=A0 Now Cass=
andra is reporting corrupt sstables.=A0 Does this mean I can&#39;t just sim=
ply back up var/lib directory (use snapshots instead) ? We don&#39;t have m=
uch data right now so I thought it&#39;d be easier to back up the entire di=
rectory.<br>
<br>Thanks<br><br><div class=3D"gmail_quote">On Thu, May 5, 2011 at 2:56 PM=
, Sylvain Lebresne <span dir=3D"ltr">&lt;<a href=3D"mailto:sylvain@datastax=
.com">sylvain@datastax.com</a>&gt;</span> wrote:<br><blockquote class=3D"gm=
ail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-le=
ft:1ex;">
<div><div></div><div class=3D"h5">On Thu, May 5, 2011 at 8:38 PM, Wenjun Ch=
e &lt;<a href=3D"mailto:wenjun@openf.in">wenjun@openf.in</a>&gt; wrote:<br>
&gt; Hello,<br>
&gt;<br>
&gt; I have a one node cluster (refresh install from 0.7.4 and upgraded to =
0.7.5<br>
&gt; last week).=A0 The data is being backed up by=A0 a cron job that perio=
dically<br>
&gt; tar/gzip entire<br>
&gt; var/lib directory.=A0 when I tested the backup by restoring the last t=
ar file,<br>
&gt; I am seeing the following exception:<br>
&gt;<br>
&gt; DEBUG 13:45:37,830 Load statistics for<br>
&gt; \var\lib\cassandra\data\Appoji\ApplicationUserPermission-f-6<br>
&gt; ERROR 13:45:37,832 Exception encountered during startup.<br>
&gt; java.lang.AssertionError<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.io.sstable.SSTable.estimateRowsFromIndex(SSTable.=
java:233)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:=
286)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:=
191)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.db.ColumnFamilyStore.&lt;init&gt;(ColumnFamilySto=
re.java:232)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu=
mnFamilyStore.java:<br>
&gt; 480)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(Colu=
mnFamilyStore.java:<br>
&gt; 461)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Table.initCf(Table.ja=
va:308)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Table.&lt;init&gt;(Ta=
ble.java:245)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at org.apache.cassandra.db.Table.open(Table.java=
:106)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCas=
sandraDaemon.java:1<br>
&gt; 61)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.service.AbstractCassandraDaemon.activate(Abstract=
CassandraDaemon.jav<br>
&gt; a:315)<br>
&gt; =A0=A0=A0=A0=A0=A0=A0 at<br>
&gt; org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:=
79)<br>
&gt; Exception encountered during startup.<br>
&gt;<br>
&gt; I checked few other earlier backup tar files and they seem to be fine.=
=A0 Can<br>
&gt; this be caused by the way I am backing=A0 it up?<br>
<br>
</div></div>I think that could be triggered if you have a 0 bytes index fil=
e for<br>
instance, so if you had one such<br>
index file in the backup, that could be a problem.<br>
<br>
--<br>
<font color=3D"#888888">Sylvain<br>
</font></blockquote></div><br>

--bcaec501608b59a44804a28cea99--