Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D81EE91B0 for ; Thu, 1 Mar 2012 12:53:11 +0000 (UTC) Received: (qmail 35105 invoked by uid 500); 1 Mar 2012 12:53:09 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 35084 invoked by uid 500); 1 Mar 2012 12:53:09 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 35074 invoked by uid 99); 1 Mar 2012 12:53:09 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Mar 2012 12:53:09 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of skrolle@gmail.com designates 209.85.210.172 as permitted sender) Received: from [209.85.210.172] (HELO mail-iy0-f172.google.com) (209.85.210.172) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Mar 2012 12:53:03 +0000 Received: by iazz13 with SMTP id z13so942235iaz.31 for ; Thu, 01 Mar 2012 04:52:42 -0800 (PST) Received-SPF: pass (google.com: domain of skrolle@gmail.com designates 10.42.157.133 as permitted sender) client-ip=10.42.157.133; Authentication-Results: mr.google.com; spf=pass (google.com: domain of skrolle@gmail.com designates 10.42.157.133 as permitted sender) smtp.mail=skrolle@gmail.com; dkim=pass header.i=skrolle@gmail.com Received: from mr.google.com ([10.42.157.133]) by 10.42.157.133 with SMTP id d5mr3349307icx.46.1330606362204 (num_hops = 1); Thu, 01 Mar 2012 04:52:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=HAcIDIPtPH6oRojxoJMka2Sa0BKaJocQa798rsOm8jw=; b=TQHI2GMp1pATN0uYtHRLPuS7kcOlppJ0XceDkiyXbhHfv243RFqPd85pW45Zj1HZ5d HnMRWXFsw+LEbFdyoYwxel4NwSjHuR9HHTGUfNw6Lm34a+dvdFlwwTlt7gyZ/xRbhMZm 3qPHPz9dRGRXRTKvAHb8T7yXgpc0OzMH1T2mY= MIME-Version: 1.0 Received: by 10.42.157.133 with SMTP id d5mr2738164icx.46.1330606362122; Thu, 01 Mar 2012 04:52:42 -0800 (PST) Received: by 10.231.124.102 with HTTP; Thu, 1 Mar 2012 04:52:42 -0800 (PST) In-Reply-To: References: Date: Thu, 1 Mar 2012 13:52:42 +0100 Message-ID: Subject: Re: Huge amount of empty files in data directory. From: =?ISO-8859-1?Q?Henrik_Schr=F6der?= To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=90e6ba6138ae8cd7e504ba2defb8 X-Virus-Checked: Checked by ClamAV on apache.org --90e6ba6138ae8cd7e504ba2defb8 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Great, thanks! /Henrik On Thu, Mar 1, 2012 at 13:08, Sylvain Lebresne wrote= : > It's a bug, namely: https://issues.apache.org/jira/browse/CASSANDRA-3616 > You'd want to upgrade. > > -- > Sylvain > > On Thu, Mar 1, 2012 at 1:01 PM, Henrik Schr=F6der wro= te: > > Hi, > > > > We're running Cassandra 1.0.6 on Windows, and noticed that the amount o= f > > files in the datadirectory just keeps growing. We have about 60GB of da= ta > > per node, we do a major compaction about once a week, but after > compaction > > there's a lot of 0-byte temp files and old files that are kept for some > > reason. After 50 days of uptime there was around 50000 files in each > > datadirectory, but when we restarted a server it deleted all the > unnecessary > > files and it shrunk down to about 200 files. > > > > We're running without compression, and with the regular compaction > strategy, > > not leveldb. I don't remember seeing this behaviour in older versions o= f > > Cassandra, shouldn't it delete temp files while running? Is it possible > to > > force it to delete temp files while running? Is this fixed in a later > > version? Or do we have to periodically restart servers to clean up the > > datadirectories? > > > > > > /Henrik Schr=F6der > --90e6ba6138ae8cd7e504ba2defb8 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Great, thanks!


/Henrik

On Thu,= Mar 1, 2012 at 13:08, Sylvain Lebresne <sylvain@datastax.com> wrote:
It's a bug, namely: https://issues.apache.org/jira/browse/CASSA= NDRA-3616
You'd want to upgrade.

--
Sylvain

On Thu, Mar 1, 2012 at 1:01 PM, Henrik Schr=F6der <skrolle@gmail.com> wrote:
> Hi,
>
> We're running Cassandra 1.0.6 on Windows, and noticed that the amo= unt of
> files in the datadirectory just keeps growing. We have about 60GB of d= ata
> per node, we do a major compaction about once a week, but after compac= tion
> there's a lot of 0-byte temp files and old files that are kept for= some
> reason. After 50 days of uptime there was around 50000 files in each > datadirectory, but when we restarted a server it deleted all the unnec= essary
> files and it shrunk down to about 200 files.
>
> We're running without compression, and with the regular compaction= strategy,
> not leveldb. I don't remember seeing this behaviour in older versi= ons of
> Cassandra, shouldn't it delete temp files while running? Is it pos= sible to
> force it to delete temp files while running? Is this fixed in a later<= br> > version? Or do we have to periodically restart servers to clean up the=
> datadirectories?
>
>
> /Henrik Schr=F6der

--90e6ba6138ae8cd7e504ba2defb8--