Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of omerhj@gmail.com designates
 209.85.161.44 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:date:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=CWbN45yRto5CGmL3+IhF4xUS87gX2Uujw/bg3VswtiAFPiLlikQYPVtTsGVrK0aehK
         690mkJYeLk0NHJV0PmEMAG5XENS7LID4Ik14IJUdh/+fs8nnNv7WPxiWvnnlxyfLUTJ9
         NEbHnZVcuhH+HqClhYgYUeJIMqPj/pCQhzrN4=
MIME-Version: 1.0
Date: Thu, 3 Feb 2011 10:45:50 -0500
Message-ID: <AANLkTi=f_s_BR5YUqpZd1MeQMkRyVq-gmtSHBUtizxCY@mail.gmail.com>
Subject: Mitigating CASSANDRA-2059 -- leftover files
From: Omer van der Horst Jansen <omerhj@gmail.com>
To: user <user@cassandra.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Jonathan pointed out in another thread that it looks like I'm running
into CASSANDRA-2059, where secondary files are not being properly
deleted. My production data set at any given time is less than 100 MB
in size, but the Cassandra data directories on each instance are using
30 to 40 times as much space right now, and steadily growing.

I understand I can remove the root cause of the problem by applying
the patch that's attached to the bug report or by upgrading to =A00.7.1
when it's out.

In the meantime, is it safe to manually delete stale files while
Cassandra is running? =A0And how do I determine when a set of files is
stale?

I'd assume that a given set of files is deletable if there is no
-Data.db file and the -Compacted file has zero length.

Example of what I would think is a set of stale files, without a -Data,db f=
ile:

ls -l *3090*
-rw-rw-r-- 1 user group =A0 =A00 Feb =A03 10:00 Payload-e-3090-Compacted
-rw-rw-r-- 1 user group =A0245 Feb =A03 10:00 Payload-e-3090-Filter.db
-rw-rw-r-- 1 user group 4362 Feb =A03 10:00 Payload-e-3090-Index.db
-rw-rw-r-- 1 user group 4840 Feb =A03 10:00 Payload-e-3090-Statistics.db

I've got these all the way back to =A0Payload-e-1-Index.db.

Non-stale files:
ls -l *3095*
-rw-rw-r-- 1 user group =A0 =A0 =A0 =A00 Feb =A03 10:35 Payload-e-3095-Comp=
acted
-rw-rw-r-- 1 user group 41269735 Feb =A03 10:14 Payload-e-3095-Data.db
-rw-rw-r-- 1 user group =A0 286405 Feb =A03 10:14 Payload-e-3095-Filter.db
-rw-rw-r-- 1 user group =A07608022 Feb =A03 10:14 Payload-e-3095-Index.db
-rw-rw-r-- 1 user group =A0 =A0 4840 Feb =A03 10:14 Payload-e-3095-Statisti=
cs.db

There is an active Data.db file, so I'd leave this group alone.

--Omer