Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8C575106BA for ; Thu, 18 Jul 2013 09:41:59 +0000 (UTC) Received: (qmail 70351 invoked by uid 500); 18 Jul 2013 09:41:55 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 70329 invoked by uid 500); 18 Jul 2013 09:41:55 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 70315 invoked by uid 99); 18 Jul 2013 09:41:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jul 2013 09:41:54 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a44.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jul 2013 09:41:49 +0000 Received: from homiemail-a44.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a44.g.dreamhost.com (Postfix) with ESMTP id 9934E11805C for ; Thu, 18 Jul 2013 02:41:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :content-type:message-id:mime-version:subject:date:references:to :in-reply-to; s=thelastpickle.com; bh=lLDRxrmmz5KNlksTzdRV6dXZS3 w=; b=Ra4DajoD0KkAUzwn8sqyc6QlAci3GbXSsbkgQPBhipm2+SCYuEjD9Q4/rD LtaIuKJWP71z0prpQrzSz7V8gIMadyLPuSU+7DHfW5iaFoY4rJ/Gw90rJoKlqTHI G09z4OsY5lY1vgo9ToFPyAwIi3rwdmCoKqkBSUH0IzDk+Kqnk= Received: from [172.16.1.7] (unknown [203.86.207.101]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a44.g.dreamhost.com (Postfix) with ESMTPSA id 188A9118057 for ; Thu, 18 Jul 2013 02:41:25 -0700 (PDT) From: aaron morton Content-Type: multipart/alternative; boundary="Apple-Mail=_78312EF9-F554-4300-8D9A-61A07260E391" Message-Id: <6025F88C-9086-462B-8B2D-C5F4B9C1D689@thelastpickle.com> Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: sstable size ? Date: Thu, 18 Jul 2013 21:41:24 +1200 References: To: user@cassandra.apache.org In-Reply-To: X-Mailer: Apple Mail (2.1508) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_78312EF9-F554-4300-8D9A-61A07260E391 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Does this help ? = http://www.mail-archive.com/user@cassandra.apache.org/msg30973.html Can you pull the data off the node so you can test it somewhere safe ?=20= Cheers ----------------- Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 18/07/2013, at 2:20 PM, "Langston, Jim" = wrote: > Thanks, this does look like what I'm experiencing. Can someone=20 > post a walkthrough ? The README and the sstablesplit script=20 > don't seem to cover it use in any detail. >=20 > Jim >=20 > From: Colin Blower > Reply-To: > Date: Wed, 17 Jul 2013 16:49:59 -0700 > To: "user@cassandra.apache.org" > Subject: Re: sstable size ? >=20 > Take a look at the very recent thread called 'Alternate "major = compaction"'. There are some ideas in there about splitting up a large = SSTable. >=20 > http://www.mail-archive.com/user@cassandra.apache.org/msg30956.html >=20 >=20 > On 07/17/2013 04:17 PM, Langston, Jim wrote: >> Hi all, >>=20 >> Is there a way to get an SSTable to a smaller size ? By this I mean = that I=20 >> currently have an SSTable that is nearly 1.2G, so that subsequent = SSTables >> when they compact are trying to grow to that size. The result is that = when=20 >> the min_compaction_threshold reaches it value and a compaction is = needed,=20 >> the compaction is taking a long time as the file grows (it is = currently at 52MB and >> takes ~22s to compact). >>=20 >> I'm not sure how the SSTable initially grew to its current size of = 1.2G, since the >> servers have been up for a couple of years. I hadn't noticed until I = just upgraded to 1.2.6, >> but now I see it affects everything.=20 >>=20 >>=20 >> Jim >=20 >=20 > --=20 > Colin Blower > Software Engineer > Barracuda Networks Inc. > +1 408-342-5576 (o) --Apple-Mail=_78312EF9-F554-4300-8D9A-61A07260E391 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Does = this help ? http://www.mail-archive.com/user@cassandra.apache.org/msg30973.html=

Can you pull the data off the node so you can test = it somewhere safe = ? 

Cheers

http://www.thelastpickle.com

On 18/07/2013, at 2:20 PM, "Langston, Jim" <Jim.Langston@compuware.com&= gt; wrote:

Thanks, this does look like what I'm experiencing. Can = someone 
post a walkthrough ? The README and the sstablesplit = script 
don't seem to cover it use in any detail.

Jim

From: Colin Blower <cblower@barracuda.com>
Reply-To: <user@cassandra.apache.org>= ;
Date: Wed, 17 Jul 2013 16:49:59 = -0700
To: "user@cassandra.apache.org" = <user@cassandra.apache.org>= ;
Subject: Re: sstable size ?

Take a look at the very recent thread = called 'Alternate "major compaction"'. There are some ideas in there = about splitting up a large SSTable.

http://www.mail-archive.com/user@cassandra.apache.org/msg30956.html=


On 07/17/2013 04:17 PM, Langston, Jim wrote:
Hi all,

Is there a way to get an SSTable to a smaller size ? By this I mean = that I 
currently have an SSTable that is nearly 1.2G, so that subsequent = SSTables
when they compact are trying to grow to that size. The result is = that when 
the min_compaction_threshold reaches it value and a compaction = is needed, 
the compaction is taking a long time as the file grows (it is = currently at 52MB and
takes ~22s to compact).

I'm not sure how the SSTable initially grew to its current size of = 1.2G, since the
servers have been up for a couple of years. I hadn't noticed until = I just upgraded to 1.2.6,
but now I see it affects everything. 


Jim


--
Colin = Blower
Software Engineer
Barracuda Networks Inc.
+1 408-342-5576 (o)

= --Apple-Mail=_78312EF9-F554-4300-8D9A-61A07260E391--