Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8D030CC36 for ; Tue, 18 Jun 2013 23:43:05 +0000 (UTC) Received: (qmail 49639 invoked by uid 500); 18 Jun 2013 23:43:03 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 49516 invoked by uid 500); 18 Jun 2013 23:43:03 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 49507 invoked by uid 99); 18 Jun 2013 23:43:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Jun 2013 23:43:03 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED X-Spam-Check-By: apache.org Received-SPF: error (athena.apache.org: local policy) Received: from [74.125.149.244] (HELO na3sys009aog118.obsmtp.com) (74.125.149.244) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 18 Jun 2013 23:42:58 +0000 Received: from mail-ve0-f169.google.com ([209.85.128.169]) (using TLSv1) by na3sys009aob118.postini.com ([74.125.148.12]) with SMTP ID DSNKUcDwWWrmjCo6Vrz94LflEvNDs38PyFwR@postini.com; Tue, 18 Jun 2013 16:42:38 PDT Received: by mail-ve0-f169.google.com with SMTP id m1so3588121ves.14 for ; Tue, 18 Jun 2013 16:42:16 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=RD0uLone11LCBEF6uOZmLQHRF8gsZqEscLxpTvVrV3g=; b=MpSvrGcYArdEPYsQ/+FKBE1CFnBOJed3WEDZDL5hUiztS95O+VryJlwRKqApVNBN94 nwUDw4jk7X3Juz86U2o6DrQbT16acnR4wZ8lrZRtrL9Y2GTiOcbqwSGOw91gqZHC+GrF UTOIiD+GNYOjKexpJsgKDc8BUROkboNNjVAN6e+vDRdmVaXVitdGDtQjEl4JWoK240h/ CTjDByo+p8cvQ8hf8iIQBUxbz0vNu6CvHJiTfilRAPkdp5UKtw3fAUUMW4/NLrr8wwUH aCe0XbE7f9y3kNQKP+8/kxso7nZhw7+enUJ2IQdv/FY1W/rWVJWZy8XClwSuLQIbgk/B Xnsg== X-Received: by 10.58.182.103 with SMTP id ed7mr63289vec.70.1371598936627; Tue, 18 Jun 2013 16:42:16 -0700 (PDT) X-Received: by 10.58.182.103 with SMTP id ed7mr63282vec.70.1371598936387; Tue, 18 Jun 2013 16:42:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.181.9 with HTTP; Tue, 18 Jun 2013 16:41:56 -0700 (PDT) In-Reply-To: References: From: Franc Carter Date: Wed, 19 Jun 2013 09:41:56 +1000 Message-ID: Subject: Re: Compaction not running To: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=047d7b676e1c60d24504df7643ca X-Gm-Message-State: ALoCoQnu3UMWfAot42M997AuL4B/7cmBYBUYcK9zVdTuNhthLBYCJGs1uxDO2SsGNKlGJXFpd513muvIhUcLPLo8/9nSWioUnqM2Cud1VlJzWf3IurhUpYQGVAdR3SaiaCpnHk4qLoPqd0RJZ4MComH9fD8DvxPYYbRSsOXteikJQ7exEyeTwOQ= X-Virus-Checked: Checked by ClamAV on apache.org --047d7b676e1c60d24504df7643ca Content-Type: text/plain; charset=ISO-8859-1 On Wed, Jun 19, 2013 at 9:34 AM, Bryan Talbot wrote: > Manual compaction for LCS doesn't really do much. It certainly doesn't > compact all those little files into bigger files. What makes you think > that compactions are not occurring? > > Yeah, that's what I thought, however:- nodetool compactionstats, gives pending tasks: 13120 Active compaction remaining time : n/a when I run nodetool compact in a loop the pending tasks goes down gradually. This node also has vastly higher latencies (x10) than the other nodes. I saw this with a previous CF than I 'manually compacted', and when the pending tasks reached low numbers (stuck on 9) then latencies were back to low milliseconds cheers > -Bryan > > > > On Tue, Jun 18, 2013 at 3:59 PM, Franc Carter wrote: > >> On Sat, Jun 15, 2013 at 11:49 AM, Franc Carter > > wrote: >> >>> On Sat, Jun 15, 2013 at 8:48 AM, Robert Coli wrote: >>> >>>> On Wed, Jun 12, 2013 at 3:26 PM, Franc Carter < >>>> franc.carter@sirca.org.au> wrote: >>>> > We are running a test system with Leveled compaction on >>>> Cassandra-1.2.4. >>>> > While doing an initial load of the data one of the nodes ran out of >>>> file >>>> > descriptors and since then it hasn't been automatically compacting. >>>> >>>> You have (at least) two options : >>>> >>>> 1) increase file descriptors available to Cassandra with ulimit, if >>>> possible >>>> 2) increase the size of your sstables with levelled compaction, such >>>> that you have fewer of them >>>> >>> >>> Oops, I wasn't clear enough. >>> >>> I have increased the number of file descriptors and no longer have a >>> file descriptor issue. However the node still doesn't compact >>> automatically. If I run a 'nodetool compact' it will do a small amount of >>> compaction and then stop. The Column Family is using LCS >>> >> >> Any ideas on this - compaction is still not automatically running for one >> of my nodes >> >> thanks >> >> >>> >>> cheers >>> >>> >>>> >>>> =Rob >>>> >>> >>> >>> >>> -- >>> >>> *Franc Carter* | Systems architect | Sirca Ltd >>> >>> >>> franc.carter@sirca.org.au | www.sirca.org.au >>> >>> Tel: +61 2 8355 2514 >>> >>> Level 4, 55 Harrington St, The Rocks NSW 2000 >>> >>> PO Box H58, Australia Square, Sydney NSW 1215 >>> >>> >>> >> >> >> -- >> >> *Franc Carter* | Systems architect | Sirca Ltd >> >> >> franc.carter@sirca.org.au | www.sirca.org.au >> >> Tel: +61 2 8355 2514 >> >> Level 4, 55 Harrington St, The Rocks NSW 2000 >> >> PO Box H58, Australia Square, Sydney NSW 1215 >> >> >> > -- *Franc Carter* | Systems architect | Sirca Ltd franc.carter@sirca.org.au | www.sirca.org.au Tel: +61 2 8355 2514 Level 4, 55 Harrington St, The Rocks NSW 2000 PO Box H58, Australia Square, Sydney NSW 1215 --047d7b676e1c60d24504df7643ca Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On Wed, Jun 19, 2013 at 9:34 AM, Bryan Talbot <btalbot@aeriagames.com= > wrote:
Manual compaction for LCS doesn't really do much. =A0I= t certainly doesn't compact all those little files into bigger files. = =A0What makes you think that compactions are not occurring?


Yeah, that's what I= thought, however:-

nodetool compactionstats, gives

=A0=A0=A0= pending tasks: 13120
=A0=A0 Active compaction remaining time :=A0=A0=A0= =A0=A0=A0=A0 n/a

when I run nodetool compact in a loop the pending tasks goes down gradu= ally.

This node also has vastly higher latencies (x10) than the othe= r nodes. I saw this with a previous CF than I 'manually compacted',= and when the pending tasks reached low numbers (stuck on 9) then latencies= were back to low milliseconds

cheers
=A0
-Bryan



O= n Tue, Jun 18, 2013 at 3:59 PM, Franc Carter <franc.carter@sirca.= org.au> wrote:
On Sat, Jun 15, 2013 at 11:49 AM, Franc= Carter <franc.carter@sirca.org.au> wrote:
On Sat, Jun 15, 2013 at 8:48 AM, Robert Coli &l= t;rcoli@eventbrit= e.com> wrote:
On Wed, Jun 12, 2013 at 3:26 PM, Franc Carter <franc.carter@sirca.org.au>= ; wrote:
> We are running a test system with Leveled compaction on Cassandra-1.2.= 4.
> While doing an initial load of the data one of the nodes ran out of fi= le
> descriptors and since then it hasn't been automatically compacting= .

You have (at least) two options :

1) increase file descriptors available to Cassandra with ulimit, if possibl= e
2) increase the size of your sstables with levelled compaction, such
that you have fewer of them

Oops, I wasn't clear enough.

I have increased= the number of file descriptors and no longer have a file descriptor issue.= However the node still doesn't compact automatically. If I run a '= nodetool compact' it will do a small amount of compaction and then stop= . The Column Family is using LCS

Any ideas on this - compaction is still n= ot automatically running for one of my nodes

thanks
=A0

cheers
=A0

--

Franc Carter<= /b> |<= /span> Systems architect | Sirca Ltd

franc.carter@sirca.org.au=A0|=A0www.sirca.org.au

Tel:= =A0+61 2 8355 2514

Level 4, 55 Harrington St, The Rocks NSW 2000

PO Box H58, Australia Square, Sydney NSW 1215<= /span>





--=

Franc Carter<= /b> |<= /span> Systems architect | Sirca Ltd

franc.carter@sirca.org.au=A0|=A0www.sirca.org.au

Tel:= =A0+61 2 8355 2514

Level 4, 55 Harrington St, The Rocks NSW 2000

PO Box H58, Australia Square, Sydney NSW 1215<= /span>






--

Franc Carter<= /b> |<= /span> Systems architect | Sirca Ltd

franc.carter@sirca.org.au=A0|=A0www.sirca.org.au

Tel:= =A0+61 2 8355 2514

Level 4, 55 Harrington St, The Rocks NSW 2000

PO Box H58, Australia Square, Sydney NSW 1215<= /span>


--047d7b676e1c60d24504df7643ca--