Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3D111469B for ; Thu, 23 Jun 2011 08:24:15 +0000 (UTC) Received: (qmail 76303 invoked by uid 500); 23 Jun 2011 08:24:13 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 75064 invoked by uid 500); 23 Jun 2011 08:24:06 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 75052 invoked by uid 99); 23 Jun 2011 08:24:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jun 2011 08:24:05 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jonathan.colby@gmail.com designates 209.85.214.44 as permitted sender) Received: from [209.85.214.44] (HELO mail-bw0-f44.google.com) (209.85.214.44) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jun 2011 08:24:00 +0000 Received: by bwz13 with SMTP id 13so1587930bwz.31 for ; Thu, 23 Jun 2011 01:23:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:content-type:mime-version:subject:from :in-reply-to:date:content-transfer-encoding:message-id:references:to :x-mailer; bh=BiseyIouDZfWOwpb/xS7sJ4gVwqCvp8bog0Fh5qqMrI=; b=WNdyanPZRTrzBD2eyhgkHdGlJ1Jjdq3vsUcy11WmQ6PfR+AiPLMIEDqLTLPMDon5EJ LaFEyDCAVyxgMKfjRE8Ul6TNWGiNM5g7ATDYFf1lMhUchs7e1RwiZunOKUT3CzXffykT z51AOZmyocC7mKqFn+2WANC/pmFhZM1LAqW6A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=content-type:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to:x-mailer; b=epTFm5oTIRup9xZeWaDO47uB8/9xSuGWWt+CRYfh4ChJkPUeLb1djTCsBz9ef3Yb6+ tMK1nuaq29kO+JEd08zwWJm6Iw9+Pi0ibcyVxqBSaZeAk6ereJ1CxH24EDO2PmU1OARV 32tUsHD4vL+SGVZLFzpenyLaLjZiR5lgiOyiM= Received: by 10.204.20.147 with SMTP id f19mr568469bkb.163.1308817419042; Thu, 23 Jun 2011 01:23:39 -0700 (PDT) Received: from [10.250.128.161] ([195.234.136.12]) by mx.google.com with ESMTPS id l24sm538279bkw.15.2011.06.23.01.23.37 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 23 Jun 2011 01:23:38 -0700 (PDT) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Apple Message framework v1084) Subject: Re: insufficient space to compact even the two smallest files, aborting From: Jonathan Colby In-Reply-To: <74C81686-7AEF-4842-A2D0-3FD0DA11BAEE@thelastpickle.com> Date: Thu, 23 Jun 2011 10:23:36 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1307704586.19401.60.camel@mierdi-laptop> <1307718655.10346.1.camel@mierdi-laptop> <1307969934.2758.2.camel@mierdi-laptop> <1307976917.2758.5.camel@mierdi-laptop> <1308751453.2601.18.camel@mierdi-laptop> <74C81686-7AEF-4842-A2D0-3FD0DA11BAEE@thelastpickle.com> To: user@cassandra.apache.org X-Mailer: Apple Mail (2.1084) A compaction will be triggered when "min" number of same sized SStable = files are found. So what's actually the purpose of the "max" part of = the threshold? =20 On Jun 23, 2011, at 12:55 AM, aaron morton wrote: > Setting them to 2 and 2 means compaction can only ever compact 2 files = at time, so it will be worse off. >=20 > Lets the try following: >=20 > - restore the compactions settings to the default 4 and 32 > - run `ls -lah` in the data dir and grab the output > - run `nodetool flush` this will trigger minor compaction once the = memtables have been flushed > - check the logs for messages from 'CompactionManager' > - when done grab the output from `ls -lah` again.=20 >=20 > Hope that helps.=20 >=20 >=20 > ----------------- > Aaron Morton > Freelance Cassandra Developer > @aaronmorton > http://www.thelastpickle.com >=20 > On 23 Jun 2011, at 02:04, H=E9ctor Izquierdo Seliva wrote: >=20 >> Hi All. I set the compaction threshold at minimum 2, maximum 2 and = try >> to run compact, but it's not doing anything. There are over 69 = sstables >> now, read performance is horrible, and it's taking an insane amount = of >> space. Maybe I don't quite get how the new per bucket stuff works, = but I >> think this is not normal behaviour. >>=20 >> El lun, 13-06-2011 a las 10:32 -0500, Jonathan Ellis escribi=F3: >>> As Terje already said in this thread, the threshold is per bucket >>> (group of similarly sized sstables) not per CF. >>>=20 >>> 2011/6/13 H=E9ctor Izquierdo Seliva : >>>> I was already way over the minimum. There were 12 sstables. Also, = is >>>> there any reason why scrub got stuck? I did not see anything in the >>>> logs. Via jmx I saw that the scrubbed bytes were equal to one of = the >>>> sstables size, and it stuck there for a couple hours . >>>>=20 >>>> El lun, 13-06-2011 a las 22:55 +0900, Terje Marthinussen escribi=F3: >>>>> That most likely happened just because after scrub you had new = files >>>>> and got over the "4" file minimum limit. >>>>>=20 >>>>> https://issues.apache.org/jira/browse/CASSANDRA-2697 >>>>>=20 >>>>> Is the bug report. >>>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>=20 >>>=20 >>>=20 >>=20 >>=20 >=20