Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7CBB0103FD for ; Wed, 24 Apr 2013 20:38:13 +0000 (UTC) Received: (qmail 59209 invoked by uid 500); 24 Apr 2013 20:38:11 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 59184 invoked by uid 500); 24 Apr 2013 20:38:10 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 59176 invoked by uid 99); 24 Apr 2013 20:38:10 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Apr 2013 20:38:10 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [192.174.58.133] (HELO XEDGEB.nrel.gov) (192.174.58.133) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Apr 2013 20:38:06 +0000 Received: from XHUBA.nrel.gov (10.20.4.58) by XEDGEB.nrel.gov (192.174.58.133) with Microsoft SMTP Server (TLS) id 8.3.298.1; Wed, 24 Apr 2013 14:37:41 -0600 Received: from MAILBOX2.nrel.gov ([fe80::19a0:6c19:6421:12f]) by XHUBA.nrel.gov ([::1]) with mapi; Wed, 24 Apr 2013 14:37:45 -0600 From: "Hiller, Dean" To: "user@cassandra.apache.org" Date: Wed, 24 Apr 2013 14:37:45 -0600 Subject: Re: compaction throughput rate not even close to 16MB Thread-Topic: compaction throughput rate not even close to 16MB Thread-Index: Ac5BK5LmnHkhAB54QM2VSigHWpcMSQ== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.3.2.130206 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Thanks much!!! Better to hear at least one other person sees the same thin= g ;). Sometimes these posts just go silent. Dean From: Edward Capriolo > Reply-To: "user@cassandra.apache.org" > Date: Wednesday, April 24, 2013 2:33 PM To: "user@cassandra.apache.org" > Subject: Re: compaction throughput rate not even close to 16MB I have noticed the same. I think in the "real" world your compaction throug= hput is limited by other things. If I had to speculate I would say that com= paction can remove expired tombstones, however doing this requires bloom fi= lter checks, etc. I think that setting is more important with multi threaded compaction and/o= r more compaction slots. In those cases it may actually throttle something. On Wed, Apr 24, 2013 at 3:54 PM, Hiller, Dean > wrote: I was wondering about the compactionthroughput. I never see ours get even = close to 16MB and I thought this is supposed to throttle compaction, right?= Ours is constantly less than 3MB/sec from looking at our logs or do I hav= e this totally wrong? How can I see the real throughput so that I can unde= rstand how to throttle it when I need to? 94,940,780 bytes to 95,346,024 (~100% of original) in 38,438ms =3D 2.365603= MB/s. 2,350,114 total rows, 2,350,022 unique. Row merge counts were {1:23= 49930, 2:92, } Thanks, Dean