Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1630D9342 for ; Wed, 4 Apr 2012 07:17:42 +0000 (UTC) Received: (qmail 45106 invoked by uid 500); 4 Apr 2012 07:17:39 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 45053 invoked by uid 500); 4 Apr 2012 07:17:39 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 45036 invoked by uid 99); 4 Apr 2012 07:17:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Apr 2012 07:17:39 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sylvain@datastax.com designates 209.85.214.172 as permitted sender) Received: from [209.85.214.172] (HELO mail-ob0-f172.google.com) (209.85.214.172) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Apr 2012 07:17:33 +0000 Received: by obbtb4 with SMTP id tb4so882331obb.31 for ; Wed, 04 Apr 2012 00:17:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding:x-gm-message-state; bh=3Movxew1JHzlbCUGqWj0Acb75Y6qxCr5ahELu5vHRIc=; b=Ykv4WsOdOTL0G/en9uEbcIOgkJTp066LLBgKWv6DJ8SSiMCqBlc2qOHbM/p8YlR6lt +5MVR6SPzkXgwqiKz4mNm1+TfACWcRx9I1dAu+tWcmvGAFDXkTtIlX3jE1htMGpXmnKJ QIQUkCF/2fF1YBFRY5p1QgJS1PzdYUAxtCsbT8sgvSK/V5+WHYHtVhkOB7XmK5nT/a9o 5FDwsWk0THXCZjUHasIpBsP1cP3+TiPAox1jopEtORhP0+c6SugN0faZwkn1huhHc0o5 8OJYjjCbcXw0YgUIes/YZ4eP32w2fUxJnNsMIhCpQ0cyPCX2lndrkuNORU3e9816+vk0 sf9A== MIME-Version: 1.0 Received: by 10.60.24.201 with SMTP id w9mr11420434oef.49.1333523832190; Wed, 04 Apr 2012 00:17:12 -0700 (PDT) Received: by 10.60.65.161 with HTTP; Wed, 4 Apr 2012 00:17:12 -0700 (PDT) In-Reply-To: References: Date: Wed, 4 Apr 2012 09:17:12 +0200 Message-ID: Subject: Re: System keyspace leak? From: Sylvain Lebresne To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQliYuPRtLI24Css19uQ++MgDFplhhtn9NIYyMz9Eb2TTIhCkf0sbxUPsBLLx+QKlQW3UtRT On Wed, Apr 4, 2012 at 3:14 AM, David Leimbach wrote: > Well I just found this: > > http://wiki.apache.org/cassandra/LiveSchemaUpdates > > which explains a ton... =A0It looks like this particular Column Family wi= ll > grow infinitely (it's just one row with a column per migration), so if I'= m > pounding on my Cassandra node with CREATE/DROP activity, I'm going to mak= e > VERY wide row. > > That tells me enough to say "don't do that!" =A0:-) All that is true in 1.0 but know that we've "fixed" it in the upcoming 1.1 (http://www.datastax.com/dev/blog/the-schema-management-renaissance). -- Sylvain > > Dave > > On Tue, Apr 3, 2012 at 6:00 PM, David Leimbach wrote: >> >> I've been trying to understand the overhead of create/drop keyspace on >> Cassandra 1.0.8. =A0It's not free, especially when I've managed to drive= up >> the LiveDiskSpaceUsed for the Migrations CF in the "system" keyspace up = to >> over 12 MB of disk. >> >> I've tried doing "nodetool -h localhost repair system" and other nodetoo= l >> commands to try to compact the SSTables involved with it, but it never w= ants >> to let go of that slowly growing space. >> >> The Cassandra node in question is in a ring of size 1. >> >> Other than clobbering my data directory, how do I get my space back? =A0= Is >> it natural for this to grow seemingly infinitely (even though it's prett= y >> small increments), or did I find a bug? >> >> The reason I ask is I need to run unit tests in a shared developer >> infrastructure with Cassandra, and we were having a little trouble with >> TRUNCATE on column families, but that might have been environmental (I'v= e >> not looked deeply into it). >> >> Which is less expensive? =A0Create/Drop, or Truncate? =A0I don't expect >> Truncate to swell the Migration Column Family because it tracks (seeming= ly) >> schema changes. >> >> Dave >> >> >