Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 870D185F5 for ; Mon, 22 Aug 2011 15:10:54 +0000 (UTC) Received: (qmail 45503 invoked by uid 500); 22 Aug 2011 15:10:52 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 45415 invoked by uid 500); 22 Aug 2011 15:10:51 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 45402 invoked by uid 99); 22 Aug 2011 15:10:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 15:10:51 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates 209.85.215.44 as permitted sender) Received: from [209.85.215.44] (HELO mail-ew0-f44.google.com) (209.85.215.44) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 22 Aug 2011 15:10:41 +0000 Received: by ewy19 with SMTP id 19so1925828ewy.31 for ; Mon, 22 Aug 2011 08:10:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=nOicQlcUYt3pnpLHuBQPl37YwD3wzqQBd6h9JLb1c8c=; b=Zny9L+98j4bVC+/2e7fbyh97F23taGa6B+a/IPXS/uZSSQYLPGEIeL6xJpdITLY1g7 +Mt8d5iZTJXYAoO6+R7lDTM/ItJcHdShJepRAYSrEr3MK7UZEPADOoxoKC3EQLJLcZ2J S6jQG4Sn8iyWeJhaZSTWIViTv23eghvSd1bOc= Received: by 10.213.106.2 with SMTP id v2mr597901ebo.33.1314025819232; Mon, 22 Aug 2011 08:10:19 -0700 (PDT) MIME-Version: 1.0 Received: by 10.213.10.18 with HTTP; Mon, 22 Aug 2011 08:09:58 -0700 (PDT) In-Reply-To: References: From: Jonathan Ellis Date: Mon, 22 Aug 2011 10:09:58 -0500 Message-ID: Subject: Re: Avoid Simultaneous Minor Compactions? To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 Specifically, look at compaction_throughput_mb_per_sec in cassandra.yaml On Mon, Aug 22, 2011 at 12:39 AM, Ryan King wrote: > You should throttle your compactions to a sustainable level. > > -ryan > > On Sun, Aug 21, 2011 at 10:22 PM, Hefeng Yuan wrote: >> We just noticed that at one time, 4 nodes were doing minor compaction together, each of them took 20~60 minutes. >> We're on 0.8.1, 6 nodes, RF5. >> This simultaneous compactions slowed down the whole cluster, we have local_quorum consistency level, therefore, dynamic_snitch is not helping us. >> >> Aside from lower down the compaction thread priority, is there any other way to tell the cluster hold on doing this if other nodes are already compacting? >> >> Thanks, >> Hefeng > -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com