Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2C2652C0B for ; Sat, 7 May 2011 12:54:59 +0000 (UTC) Received: (qmail 61775 invoked by uid 500); 7 May 2011 12:54:57 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 61748 invoked by uid 500); 7 May 2011 12:54:57 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 61740 invoked by uid 99); 7 May 2011 12:54:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 07 May 2011 12:54:57 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates 74.125.82.44 as permitted sender) Received: from [74.125.82.44] (HELO mail-ww0-f44.google.com) (74.125.82.44) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 07 May 2011 12:54:51 +0000 Received: by wwa36 with SMTP id 36so3816648wwa.25 for ; Sat, 07 May 2011 05:54:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=LNvIoN2rvn2Virlj4YVnZWPO7/A+2gMpg44oXizQEak=; b=PyqBNN5KdOLpa7JRNoGCDqQgjlat4NlAisdthljBmUEfQj4FPQp7bu9xeyGWUZUomC 0lGFkrmIy3Or/stTHVNofvOunpVB98VAXLfYxx0h2yTALIb3QB0iWrhMsDQMVjT0JO7N XP6XlkGjlYNzcsJqmvu6jmq9YmWdp1YlCg+Co= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=vhzZ/jQMPzBJX5hiK1T5Xr2iQeI7RAF6QpSdqgiRSAq4R+RgbNoAL+gyhJLW747rcB e22Vkb0aaRw24k9xmWfsq+Tovddwx5sHjqOYYM77G5TGhFZqq57yn9z+PUFnkA4Kaqem ANY05+LeulJCMszZbzjt62e8P7a3rOGelALeo= Received: by 10.216.241.132 with SMTP id g4mr823031wer.9.1304772869144; Sat, 07 May 2011 05:54:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.216.8.71 with HTTP; Sat, 7 May 2011 05:54:09 -0700 (PDT) In-Reply-To: References: From: Jonathan Ellis Date: Sat, 7 May 2011 05:54:09 -0700 Message-ID: Subject: Re: compaction strategy To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org On Sat, May 7, 2011 at 2:01 AM, Terje Marthinussen wrote: > 1. Would it make sense to make full compactions occur a bit more aggressive. I'd rather reduce the performance impact of being behind, than do more full compactions: https://issues.apache.org/jira/browse/CASSANDRA-2498 > 2. I > would think the code should be smart enough to either trigger a full > compaction and scrap the current queue, or at least merge some of those > pending tasks into larger ones Not crazy but a queue-rewriter would be nontrivial. For now I'm okay with saying "add capacity until compaction can mostly keep up." (Most people's problem is making compaction LESS aggressive, hence https://issues.apache.org/jira/browse/CASSANDRA-2156.) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com