Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9CB0D7F81 for ; Thu, 14 Jul 2011 16:08:52 +0000 (UTC) Received: (qmail 33734 invoked by uid 500); 14 Jul 2011 16:08:50 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 33676 invoked by uid 500); 14 Jul 2011 16:08:49 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 33668 invoked by uid 99); 14 Jul 2011 16:08:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jul 2011 16:08:49 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of watanabe.maki@gmail.com designates 209.85.215.172 as permitted sender) Received: from [209.85.215.172] (HELO mail-ey0-f172.google.com) (209.85.215.172) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jul 2011 16:08:41 +0000 Received: by eye13 with SMTP id 13so281449eye.31 for ; Thu, 14 Jul 2011 09:08:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; bh=eq2VEdNGOEoLtb4y0np8GHsgW+i/IS2onAXL5U22NfI=; b=cpJKZzFEtmr0xeqXBDMl55AgXL2rN4xJ7v0IgQ8rtRXlicfejxeEA0V4E2gE72oQUB usQGY7h/BxEOQgpHBZr5T/zsx96LAW6ov9vDCFa+l8t4buYGozNJ//RBdcexSXK2WzIM ftvAh5sHeJ1da5V+FeZEsE/z/8NPCwbInw0/o= MIME-Version: 1.0 Received: by 10.204.26.215 with SMTP id f23mr949398bkc.140.1310659701223; Thu, 14 Jul 2011 09:08:21 -0700 (PDT) Received: by 10.204.56.79 with HTTP; Thu, 14 Jul 2011 09:08:21 -0700 (PDT) In-Reply-To: References: Date: Fri, 15 Jul 2011 01:08:21 +0900 Message-ID: Subject: Re: Question about compaction From: Maki Watanabe To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org These 0 byte files with "-Compacted" suffix indicate that the associated sstables can be removed. In current version, Cassandra delete compacted sstables at Full GC and on startup. maki 2011/7/14 Sameer Farooqui : > Running Cassandra 0.8.1. Ran major compaction via: > > sudo /home/ubuntu/brisk/resources/cassandra/bin/nodetool -h localhost > compact & > > From what I'd read about Cassandra, I thought that after compaction all o= f > the different SSTables on disk for a Column Family would be merged into o= ne > new file. > > However, there are now a bunch of 0-sized Compacted files and a bunch of > Data files. Any ideas about why there are still so many files left? > > Also, is a minor compaction the same thing as a read-only compaction in 0= .7? > > > ubuntu@domU-12-31-39-0E-x-x:/raiddrive/data/DemoKS$ ls -l > total 270527136 > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-5670-Compacted > -rw-r--r-- 1 root root=A0 89457447799 2011-07-10 00:26 DemoCF-g-5670-Data= .db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0 193456 2011-07-10 00:26 DemoCF-g= -5670-Filter.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0 2081159 2011-07-10 00:26 DemoCF-g-5= 670-Index.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-10 00:26 > DemoCF-g-5670-Statistics.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-5686-Compacted > -rw-r--r-- 1 root root=A0=A0=A0 920521489 2011-07-09 22:03 DemoCF-g-5686-= Data.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 11776 2011-07-09 22:03 DemoCF= -g-5686-Filter.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0 126725 2011-07-09 22:03 DemoCF-g= -5686-Index.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-09 22:03 > DemoCF-g-5686-Statistics.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-5781-Compacted > -rw-r--r-- 1 root root=A0=A0=A0 223970446 2011-07-09 22:38 DemoCF-g-5781-= Data.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 7216 2011-07-09 22:38 Demo= CF-g-5781-Filter.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 32750 2011-07-09 22:38 DemoCF= -g-5781-Index.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-09 22:38 > DemoCF-g-5781-Statistics.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-5874-Compacted > -rw-r--r-- 1 root root=A0=A0=A0 156284248 2011-07-09 23:20 DemoCF-g-5874-= Data.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 5056 2011-07-09 23:20 Demo= CF-g-5874-Filter.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 10400 2011-07-09 23:20 DemoCF= -g-5874-Index.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-09 23:20 > DemoCF-g-5874-Statistics.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-6938-Compacted > -rw-r--r-- 1 root root=A0 22947541446 2011-07-10 11:43 DemoCF-g-6938-Data= .db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 49936 2011-07-10 11:43 DemoCF= -g-6938-Filter.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0 563550 2011-07-10 11:43 DemoCF-g= -6938-Index.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-10 11:43 > DemoCF-g-6938-Statistics.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-6996-Compacted > -rw-r--r-- 1 root root=A0=A0=A0 224253930 2011-07-10 11:28 DemoCF-g-6996-= Data.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 7216 2011-07-10 11:27 Demo= CF-g-6996-Filter.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 26250 2011-07-10 11:28 DemoCF= -g-6996-Index.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-10 11:28 > DemoCF-g-6996-Statistics.db > -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 03:0= 7 DemoCF-g-8324-Compacted > > --=20 w3m