Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B9DF27B43 for ; Thu, 14 Jul 2011 17:20:35 +0000 (UTC) Received: (qmail 65686 invoked by uid 500); 14 Jul 2011 17:20:33 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 65630 invoked by uid 500); 14 Jul 2011 17:20:33 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 65618 invoked by uid 99); 14 Jul 2011 17:20:32 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jul 2011 17:20:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of cassandralabs@gmail.com designates 209.85.210.172 as permitted sender) Received: from [209.85.210.172] (HELO mail-iy0-f172.google.com) (209.85.210.172) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jul 2011 17:20:26 +0000 Received: by iye7 with SMTP id 7so467379iye.31 for ; Thu, 14 Jul 2011 10:20:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=/31R3DeO1ahVQ4HpAmCAE0X8N5tF/Ns6/P5AoFhq+Jk=; b=xbihRlRI0WYcmVCkzVCHsP23QyEXgOpBO1Xic0f3c7zKOTqUOH+LIV0KaeL2b6UNev TytICu4lodjG3HS+XM8Bu/hrUoUXW1mrOAQuq7xdrjlK8aFRH51Wu/YAC9UsB5iL0gGb GpaBYDN8xaYVVUKieGUyN7N2xhVtncXZ+TYQQ= MIME-Version: 1.0 Received: by 10.42.7.146 with SMTP id e18mr2917056ice.256.1310664005726; Thu, 14 Jul 2011 10:20:05 -0700 (PDT) Received: by 10.231.3.83 with HTTP; Thu, 14 Jul 2011 10:20:05 -0700 (PDT) In-Reply-To: References: Date: Thu, 14 Jul 2011 10:20:05 -0700 Message-ID: Subject: Re: Question about compaction From: Sameer Farooqui To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=00504502c8697b335e04a80abe0a --00504502c8697b335e04a80abe0a Content-Type: text/plain; charset=ISO-8859-1 You were right, Maki. Restarting Cassandra cleaned up the directory and now there are only two SSTable files. On Thu, Jul 14, 2011 at 9:08 AM, Maki Watanabe wrote: > These 0 byte files with "-Compacted" suffix indicate that the > associated sstables can be removed. > In current version, Cassandra delete compacted sstables at Full GC and > on startup. > > maki > > > 2011/7/14 Sameer Farooqui : > > Running Cassandra 0.8.1. Ran major compaction via: > > > > sudo /home/ubuntu/brisk/resources/cassandra/bin/nodetool -h localhost > > compact & > > > > From what I'd read about Cassandra, I thought that after compaction all > of > > the different SSTables on disk for a Column Family would be merged into > one > > new file. > > > > However, there are now a bunch of 0-sized Compacted files and a bunch of > > Data files. Any ideas about why there are still so many files left? > > > > Also, is a minor compaction the same thing as a read-only compaction in > 0.7? > > > > > > ubuntu@domU-12-31-39-0E-x-x:/raiddrive/data/DemoKS$ ls -l > > total 270527136 > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-5670-Compacted > > -rw-r--r-- 1 root root 89457447799 2011-07-10 00:26 > DemoCF-g-5670-Data.db > > -rw-r--r-- 1 root root 193456 2011-07-10 00:26 > DemoCF-g-5670-Filter.db > > -rw-r--r-- 1 root root 2081159 2011-07-10 00:26 > DemoCF-g-5670-Index.db > > -rw-r--r-- 1 root root 4276 2011-07-10 00:26 > > DemoCF-g-5670-Statistics.db > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-5686-Compacted > > -rw-r--r-- 1 root root 920521489 2011-07-09 22:03 > DemoCF-g-5686-Data.db > > -rw-r--r-- 1 root root 11776 2011-07-09 22:03 > DemoCF-g-5686-Filter.db > > -rw-r--r-- 1 root root 126725 2011-07-09 22:03 > DemoCF-g-5686-Index.db > > -rw-r--r-- 1 root root 4276 2011-07-09 22:03 > > DemoCF-g-5686-Statistics.db > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-5781-Compacted > > -rw-r--r-- 1 root root 223970446 2011-07-09 22:38 > DemoCF-g-5781-Data.db > > -rw-r--r-- 1 root root 7216 2011-07-09 22:38 > DemoCF-g-5781-Filter.db > > -rw-r--r-- 1 root root 32750 2011-07-09 22:38 > DemoCF-g-5781-Index.db > > -rw-r--r-- 1 root root 4276 2011-07-09 22:38 > > DemoCF-g-5781-Statistics.db > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-5874-Compacted > > -rw-r--r-- 1 root root 156284248 2011-07-09 23:20 > DemoCF-g-5874-Data.db > > -rw-r--r-- 1 root root 5056 2011-07-09 23:20 > DemoCF-g-5874-Filter.db > > -rw-r--r-- 1 root root 10400 2011-07-09 23:20 > DemoCF-g-5874-Index.db > > -rw-r--r-- 1 root root 4276 2011-07-09 23:20 > > DemoCF-g-5874-Statistics.db > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-6938-Compacted > > -rw-r--r-- 1 root root 22947541446 2011-07-10 11:43 > DemoCF-g-6938-Data.db > > -rw-r--r-- 1 root root 49936 2011-07-10 11:43 > DemoCF-g-6938-Filter.db > > -rw-r--r-- 1 root root 563550 2011-07-10 11:43 > DemoCF-g-6938-Index.db > > -rw-r--r-- 1 root root 4276 2011-07-10 11:43 > > DemoCF-g-6938-Statistics.db > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-6996-Compacted > > -rw-r--r-- 1 root root 224253930 2011-07-10 11:28 > DemoCF-g-6996-Data.db > > -rw-r--r-- 1 root root 7216 2011-07-10 11:27 > DemoCF-g-6996-Filter.db > > -rw-r--r-- 1 root root 26250 2011-07-10 11:28 > DemoCF-g-6996-Index.db > > -rw-r--r-- 1 root root 4276 2011-07-10 11:28 > > DemoCF-g-6996-Statistics.db > > -rw-r--r-- 1 root root 0 2011-07-13 03:07 > DemoCF-g-8324-Compacted > > > > > > > > -- > w3m > --00504502c8697b335e04a80abe0a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable You were right, Maki. Restarting Cassandra cleaned up the directory and now= there are only two SSTable files.


On= Thu, Jul 14, 2011 at 9:08 AM, Maki Watanabe <watanabe.maki@gmail.com> = wrote:
These 0 byte files with "-Compacted&qu= ot; suffix indicate that the
associated sstables can be removed.
In current version, Cassandra delete compacted sstables at Full GC and
on startup.

maki


2011/7/14 Sameer Farooqui <ca= ssandralabs@gmail.com>:
> Running Cassandra 0.8.1. Ran major c= ompaction via:
>
> sudo /home/ubuntu/brisk/resources/cassandra/bin/nodetool -h localhost<= br> > compact &
>
> From what I'd read about Cassandra, I thought that after compactio= n all of
> the different SSTables on disk for a Column Family would be merged int= o one
> new file.
>
> However, there are now a bunch of 0-sized Compacted files and a bunch = of
> Data files. Any ideas about why there are still so many files left? >
> Also, is a minor compaction the same thing as a read-only compaction i= n 0.7?
>
>
> ubuntu@domU-12-31-39-0E-x-x:/raiddrive/data/DemoKS$ ls -l
> total 270527136
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-5670-Compacted
> -rw-r--r-- 1 root root=A0 89457447799 2011-07-10 00:26 DemoCF-g-5670-D= ata.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0 193456 2011-07-10 00:26 DemoC= F-g-5670-Filter.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0 2081159 2011-07-10 00:26 DemoCF-= g-5670-Index.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-10 00:26 > DemoCF-g-5670-Statistics.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-5686-Compacted
> -rw-r--r-- 1 root root=A0=A0=A0 920521489 2011-07-09 22:03 DemoCF-g-56= 86-Data.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 11776 2011-07-09 22:03 Dem= oCF-g-5686-Filter.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0 126725 2011-07-09 22:03 DemoC= F-g-5686-Index.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-09 22:03 > DemoCF-g-5686-Statistics.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-5781-Compacted
> -rw-r--r-- 1 root root=A0=A0=A0 223970446 2011-07-09 22:38 DemoCF-g-57= 81-Data.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 7216 2011-07-09 22:38 D= emoCF-g-5781-Filter.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 32750 2011-07-09 22:38 Dem= oCF-g-5781-Index.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-09 22:38 > DemoCF-g-5781-Statistics.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-5874-Compacted
> -rw-r--r-- 1 root root=A0=A0=A0 156284248 2011-07-09 23:20 DemoCF-g-58= 74-Data.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 5056 2011-07-09 23:20 D= emoCF-g-5874-Filter.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 10400 2011-07-09 23:20 Dem= oCF-g-5874-Index.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-09 23:20 > DemoCF-g-5874-Statistics.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-6938-Compacted
> -rw-r--r-- 1 root root=A0 22947541446 2011-07-10 11:43 DemoCF-g-6938-D= ata.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 49936 2011-07-10 11:43 Dem= oCF-g-6938-Filter.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0 563550 2011-07-10 11:43 DemoC= F-g-6938-Index.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-10 11:43 > DemoCF-g-6938-Statistics.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-6996-Compacted
> -rw-r--r-- 1 root root=A0=A0=A0 224253930 2011-07-10 11:28 DemoCF-g-69= 96-Data.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 7216 2011-07-10 11:27 D= emoCF-g-6996-Filter.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0 26250 2011-07-10 11:28 Dem= oCF-g-6996-Index.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0 4276 2011-07-10 11:28 > DemoCF-g-6996-Statistics.db
> -rw-r--r-- 1 root root=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 0 2011-07-13 0= 3:07 DemoCF-g-8324-Compacted
>
>



--
w3m

--00504502c8697b335e04a80abe0a--