Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 29371CDA6 for ; Thu, 18 Jul 2013 19:00:15 +0000 (UTC) Received: (qmail 11391 invoked by uid 500); 18 Jul 2013 19:00:12 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 11247 invoked by uid 500); 18 Jul 2013 19:00:12 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 11234 invoked by uid 99); 18 Jul 2013 19:00:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jul 2013 19:00:11 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: encountered temporary error during SPF processing of domain of Jim.Langston@compuware.com) Received: from [216.32.181.183] (HELO ch1outboundpool.messaging.microsoft.com) (216.32.181.183) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 18 Jul 2013 19:00:05 +0000 Received: from mail120-ch1-R.bigfish.com (10.43.68.241) by CH1EHSOBE006.bigfish.com (10.43.70.56) with Microsoft SMTP Server id 14.1.225.22; Thu, 18 Jul 2013 18:59:24 +0000 Received: from mail120-ch1 (localhost [127.0.0.1]) by mail120-ch1-R.bigfish.com (Postfix) with ESMTP id 989F42400AD for ; Thu, 18 Jul 2013 18:59:24 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.240.101;KIP:(null);UIP:(null);IPV:NLI;H:BL2PRD0510HT003.namprd05.prod.outlook.com;RD:none;EFVD:NLI X-SpamScore: -1 X-BigFish: PS-1(zzbb2dI98dI9371Ic85fh4015I14ffI9a6kzz1f42h208ch1ee6h1de0h1fdah2073h1202h1e76h1d1ah1d2ah1fc6hzz1de098h17326ah18c673h1de097h1de096h1954cbh8275bh8275dhz2ei2a8h668h839hbe3he5bhf0ah1288h12a5h12bdh137ah1441h1504h1537h153bh162dh1631h1758h18e1h1946h19b5h1ad9h1b0ah1bceh1d0ch1d2eh1d3fh1dc1h1dfeh1dffh1e1dh1155h) Received-SPF: neutral (mail120-ch1: 157.56.240.101 is neither permitted nor denied by domain of compuware.com) client-ip=157.56.240.101; envelope-from=Jim.Langston@compuware.com; helo=BL2PRD0510HT003.namprd05.prod.outlook.com ;.outlook.com ; Received: from mail120-ch1 (localhost.localdomain [127.0.0.1]) by mail120-ch1 (MessageSwitch) id 1374173961910333_27544; Thu, 18 Jul 2013 18:59:21 +0000 (UTC) Received: from CH1EHSMHS001.bigfish.com (snatpool2.int.messaging.microsoft.com [10.43.68.232]) by mail120-ch1.bigfish.com (Postfix) with ESMTP id DACEF340047 for ; Thu, 18 Jul 2013 18:59:21 +0000 (UTC) Received: from BL2PRD0510HT003.namprd05.prod.outlook.com (157.56.240.101) by CH1EHSMHS001.bigfish.com (10.43.70.1) with Microsoft SMTP Server (TLS) id 14.16.227.3; Thu, 18 Jul 2013 18:59:21 +0000 Received: from BL2PRD0510MB386.namprd05.prod.outlook.com ([169.254.11.63]) by BL2PRD0510HT003.namprd05.prod.outlook.com ([10.255.100.38]) with mapi id 14.16.0329.000; Thu, 18 Jul 2013 18:59:21 +0000 From: "Langston, Jim" To: "user@cassandra.apache.org" Subject: Re: sstable size ? Thread-Topic: sstable size ? Thread-Index: AQHOg0PMPNWGkEY22kmDKRrIOqNTV5lpiimA///msICAAL6OAP//ydeAgACOrgA= Date: Thu, 18 Jul 2013 18:59:20 +0000 Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.14.0.111121 x-originating-ip: [10.255.150.4] Content-Type: multipart/alternative; boundary="_000_CE0DB24038024jimlangstoncompuwarecom_" MIME-Version: 1.0 X-MS-Exchange-CrossPremises-AuthAs: Internal X-MS-Exchange-CrossPremises-AuthMechanism: 04 X-MS-Exchange-CrossPremises-AuthSource: BL2PRD0510HT003.namprd05.prod.outlook.com X-MS-Exchange-CrossPremises-SCL: -1 X-MS-Exchange-CrossPremises-messagesource: StoreDriver X-MS-Exchange-CrossPremises-BCC: X-MS-Exchange-CrossPremises-processed-by-journaling: Journal Agent X-MS-Exchange-CrossPremises-ContentConversionOptions: False;00160000;True;;iso-8859-1 X-OrganizationHeadersPreserved: BL2PRD0510HT003.namprd05.prod.outlook.com X-OriginatorOrg: compuware.com X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn% X-Virus-Checked: Checked by ClamAV on apache.org --_000_CE0DB24038024jimlangstoncompuwarecom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I have been looking at the stuff in the zip file, and also the sstablesplit command script. This script is looking for a java class StandaloneSplitter located in the package org.apache.cassandra.tools. Where is this package located ? I looked in the lib directory but nothing c= ontains the class. Is this something I need to get as well ? Thanks, Jim From: "Langston, Jim" > Reply-To: > Date: Thu, 18 Jul 2013 10:28:39 +0000 To: "user@cassandra.apache.org" > Subject: Re: sstable size ? I saw that msg in the thread, I pulled the git files and it looks like a suite of tools, do I install them on their own ? do I replace the current ones ? its production data but I can copy the data to where I want and experiment. Jim From: aaron morton = > Reply-To: > Date: Thu, 18 Jul 2013 21:41:24 +1200 To: > Subject: Re: sstable size ? Does this help ? http://www.mail-archive.com/user@cassandra.apache.org/msg3= 0973.html Can you pull the data off the node so you can test it somewhere safe ? Cheers ----------------- Aaron Morton Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 18/07/2013, at 2:20 PM, "Langston, Jim" > wrote: Thanks, this does look like what I'm experiencing. Can someone post a walkthrough ? The README and the sstablesplit script don't seem to cover it use in any detail. Jim From: Colin Blower > Reply-To: > Date: Wed, 17 Jul 2013 16:49:59 -0700 To: "user@cassandra.apache.org" > Subject: Re: sstable size ? Take a look at the very recent thread called 'Alternate "major compaction"'= . There are some ideas in there about splitting up a large SSTable. http://www.mail-archive.com/user@cassandra.apache.org/msg30956.html On 07/17/2013 04:17 PM, Langston, Jim wrote: Hi all, Is there a way to get an SSTable to a smaller size ? By this I mean that I currently have an SSTable that is nearly 1.2G, so that subsequent SSTables when they compact are trying to grow to that size. The result is that when the min_compaction_threshold reaches it value and a compaction is needed, the compaction is taking a long time as the file grows (it is currently at = 52MB and takes ~22s to compact). I'm not sure how the SSTable initially grew to its current size of 1.2G, si= nce the servers have been up for a couple of years. I hadn't noticed until I just u= pgraded to 1.2.6, but now I see it affects everything. Jim -- Colin Blower Software Engineer Barracuda Networks Inc. +1 408-342-5576 (o) --_000_CE0DB24038024jimlangstoncompuwarecom_ Content-Type: text/html; charset="us-ascii" Content-ID: <05DA4AE9AD84F54EB640AA04A38B0EFC@namprd05.prod.outlook.com> Content-Transfer-Encoding: quoted-printable
I have been looking at the stuff in the zip file, and also the 
sstablesplit command script. This script is looking for a java
class StandaloneSplitter located in the package org.apache.c= assandra.tools.

Where is this package located ? I looked in the lib directory but noth= ing contains 
the class. Is this something I need to get as well ?

Thanks, 

Jim

From: "Langston, Jim" <= ;Jim.Langston@compuware.com>
Reply-To: <user@cassandra.apache.org>
Date: Thu, 18 Jul 2013 10:28:39 = 3;0000
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Subject: Re: sstable size ?

I saw that msg in the thread, I pulled the git files and it looks
like a suite of tools, do I install them on their own ? do I replace t= he
current ones ? its production data but I can copy the data to where
I want and experiment.

Jim

From: aaron morton <aaron@thelastpickle.com>
Reply-To: <user@cassandra.apache.org>
Date: Thu, 18 Jul 2013 21:41:24 = 3;1200
To: <user@cassandra.apache.org>
Subject: Re: sstable size ?

Does this help ? http://www.mail-archive.com/user@cassandra.apach= e.org/msg30973.html

Can you pull the data off the node so you can test it somewhere safe ?=  

Cheers

-----------------
Aaron Morton
Cassandra Consultant
New Zealand

@aaronmorton

On 18/07/2013, at 2:20 PM, "Langston, Jim" <Jim.Langston@compuware.com> wrote:<= /div>
Thanks, this does look like what I'm experiencing. Can someone 
post a walkthrough ? The README and the sstablesplit script 
don't seem to cover it use in any detail.

Jim

From: Colin Blower <cblower@barracuda.com>
Reply-To: <user@cassandra.apache.org>
Date: Wed, 17 Jul 2013 16:49:59 -07= 00
To: "user@cassandra.apache.org" <user@cassandra.apache.org>
Subject: Re: sstable size ?

Take a look at the very recent thread called= 'Alternate "major compaction"'. There are some ideas in there ab= out splitting up a large SSTable.

http://www.mail-archive.com/user@cassa= ndra.apache.org/msg30956.html


On 07/17/2013 04:17 PM, Langston, Jim wrote:
Hi all,

Is there a way to get an SSTable to a smaller size ? By this I mean th= at I 
currently have an SSTable that is nearly 1.2G, so that subsequent SSTa= bles
when they compact are trying to grow to that size. The result is that = when 
the min_compaction_threshold reaches it value and a compaction is= needed, 
the compaction is taking a long time as the file grows (it is currentl= y at 52MB and
takes ~22s to compact).

I'm not sure how the SSTable initially grew to its current size of 1.2= G, since the
servers have been up for a couple of years. I hadn't noticed until I j= ust upgraded to 1.2.6,
but now I see it affects everything. 


Jim


--
Colin B= lower
Software Engineer
Barracuda Networks Inc.
+1 408-342-5576 (o)

--_000_CE0DB24038024jimlangstoncompuwarecom_--