Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EB7E7E5DF for ; Mon, 7 Jan 2013 20:20:04 +0000 (UTC) Received: (qmail 7837 invoked by uid 500); 7 Jan 2013 20:20:02 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 7778 invoked by uid 500); 7 Jan 2013 20:20:02 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 7760 invoked by uid 99); 7 Jan 2013 20:20:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Jan 2013 20:20:02 +0000 X-ASF-Spam-Status: No, hits=-0.1 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of btv1==719473b5d2e==mkjellman@barracuda.com designates 64.235.145.82 as permitted sender) Received: from [64.235.145.82] (HELO bsf02.barracuda.com) (64.235.145.82) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Jan 2013 20:19:56 +0000 X-ASG-Debug-ID: 1357589973-03e1a54d5a1942c40004-f7dORa Received: from bn-scl-fe06.Cudanet.local (bn-scl-fe06.cudanet.local [10.8.1.48]) by bsf02.barracuda.com with ESMTP id PQU5HD7UNGHtmb8S (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Mon, 07 Jan 2013 12:19:34 -0800 (PST) X-Barracuda-Envelope-From: mkjellman@barracuda.com Received: from bn-scl-be03.Cudanet.local (10.8.1.54) by bn-scl-fe06.Cudanet.local (10.8.1.48) with Microsoft SMTP Server (TLS) id 8.3.279.1; Mon, 7 Jan 2013 12:13:29 -0800 Received: from bn-scl-be03.Cudanet.local ([::1]) by bn-scl-be03.Cudanet.local ([::1]) with mapi; Mon, 7 Jan 2013 12:13:29 -0800 From: Michael Kjellman X-Barracuda-Apparent-Source-IP: ::1 To: "user@cassandra.apache.org" Date: Mon, 7 Jan 2013 12:13:30 -0800 Subject: Re: help turning compaction..hours of run to get 0% compaction.... Thread-Topic: help turning compaction..hours of run to get 0% compaction.... X-ASG-Orig-Subj: Re: help turning compaction..hours of run to get 0% compaction.... Thread-Index: Ac3tE3TN6SKqFZH2TXCQ9W3Be7lHww== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.2.5.121010 acceptlanguage: en-US Content-Type: multipart/alternative; boundary="_000_CD106C60ABBDmkjellmanbarracudacom_" MIME-Version: 1.0 X-Barracuda-Connect: bn-scl-fe06.cudanet.local[10.8.1.48] X-Barracuda-Start-Time: 1357589974 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: http://bsf02.barracuda.com:8000/cgi-mod/mark.cgi Received-SPF: softfail (barracuda.com: domain of transitioning mkjellman@barracuda.com does not designate ::1 as permitted sender) X-Barracuda-BRTS-Status: 1 X-Virus-Scanned: by bsmtpd at barracuda.com X-Barracuda-Spam-Score: 0.02 X-Barracuda-Spam-Status: No, SCORE=0.02 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=9.0 tests=BSF_SPF_SOFTFAIL, HTML_MESSAGE, THREAD_INDEX, THREAD_TOPIC X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.2.119208 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.01 THREAD_INDEX thread-index: AcO7Y8iR61tzADqsRmmc5wNiFHEOig== 0.01 THREAD_TOPIC Thread-Topic: ...(Japanese Subject)... 0.00 HTML_MESSAGE BODY: HTML included in message 0.00 BSF_SPF_SOFTFAIL Custom Rule SPF Softfail X-Virus-Checked: Checked by ClamAV on apache.org --_000_CD106C60ABBDmkjellmanbarracudacom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Size tiered or leveled compaction? From: Brian Tarbox > Reply-To: "user@cassandra.apache.org" > Date: Monday, January 7, 2013 12:03 PM To: "user@cassandra.apache.org" > Subject: help turning compaction..hours of run to get 0% compaction.... I have a column family where I'm doing 500 inserts/sec for 12 hours or so a= t time. At some point my performance falls off a cliff due to time spent d= oing compactions. I'm seeing row after row of logs saying that after 1 or 2 hours of compacti= ing it reduced to 100% of 99% of the original. I'm trying to understand what direction this data points me to in term of c= onfiguration change. a) increase my compaction_throughput_mb_per_sec because I'm falling behi= nd (am I falling behind?) b) enable multi-threaded compaction? Any help is appreciated. Brian Southfield Public School students safely access the tech tools they need on= and off campus with the Barracuda Web Filter.=0D =0D Quick installation and easy to use- try the Barracuda Web Filter free for 3= 0 days: http://on.fb.me/Vj6JBd --_000_CD106C60ABBDmkjellmanbarracudacom_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
Size tiered or leveled c= ompaction?


=
I have a column family where I'm doing 500 inserts/sec for 12 hours or so a= t time.  At some point my performance falls off a cliff due to time sp= ent doing compactions.

I'm seeing row after row of logs saying that after 1 or= 2 hours of compactiing it reduced to 100% of 99% of the original.

I'm trying to understand what direction this data poi= nts me to in term of configuration change.

  =  a) increase my compaction_throughput_mb_per_sec because I'm falling b= ehind (am I falling behind?) 

   b)= enable multi-threaded compaction?

Any help is app= reciated.

Brian

= =0D ----------------------------------
=0D Join Barracuda Networks in the fight against hunger.
=0D To learn how you can help in your community, please visit: http://on.fb.me/= UAdL4f=0D =0D
  ­­   --_000_CD106C60ABBDmkjellmanbarracudacom_--