Return-Path: Delivered-To: apmail-incubator-cassandra-user-archive@minotaur.apache.org Received: (qmail 58961 invoked from network); 2 Dec 2009 18:33:00 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 2 Dec 2009 18:33:00 -0000 Received: (qmail 47242 invoked by uid 500); 2 Dec 2009 18:32:59 -0000 Delivered-To: apmail-incubator-cassandra-user-archive@incubator.apache.org Received: (qmail 47223 invoked by uid 500); 2 Dec 2009 18:32:59 -0000 Mailing-List: contact cassandra-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cassandra-user@incubator.apache.org Delivered-To: mailing list cassandra-user@incubator.apache.org Received: (qmail 47185 invoked by uid 99); 2 Dec 2009 18:32:59 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Dec 2009 18:32:59 +0000 X-ASF-Spam-Status: No, hits=-2.6 required=5.0 tests=AWL,BAYES_00 X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jbellis@gmail.com designates 209.85.220.214 as permitted sender) Received: from [209.85.220.214] (HELO mail-fx0-f214.google.com) (209.85.220.214) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Dec 2009 18:32:56 +0000 Received: by fxm6 with SMTP id 6so560357fxm.0 for ; Wed, 02 Dec 2009 10:32:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:message-id:subject:to:content-type :content-transfer-encoding; bh=RnA5L8jDC37jJSXKeP7n1SqM8J4hCgcWD3fFZpOb5UY=; b=sKQfApU8huPWQdwSdNMCstzHoYT1MXDsxI7TeW8wRfH6K5i/7Vbf/7UuM6i0zg0eMN XVcPj944HWKjAo4hbjXUaE87zL201mPdtMV5Dmh+X8BCxXj6TszULqQ7o20rBMIw5iKV 8muiBh9hJmjclRRUTAUt5fLBN4Sx7dSwdutME= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; b=j1GwO8kEXXJmBwWprxPAEQFIRXXEX7yFgdV6FFvvq3RtGkmU8ygYgQpw3jLiHL/DWu 33DW+4Jt7hAMB9os30ZZe9vxd0Qypcah4Av11HdAtOXnWu4/l4sTMUYSvTF81lcA2qkj ziPwN3W51DkvnosxGhmGAIc/9qveXhV6zFpCA= MIME-Version: 1.0 Received: by 10.216.87.9 with SMTP id x9mr156697wee.0.1259778755106; Wed, 02 Dec 2009 10:32:35 -0800 (PST) In-Reply-To: References: <59DD1BA8FD3C0F4C90771C18F2B5B53A4C850190C6@GVW0432EXB.americas.hpqcorp.net> <59DD1BA8FD3C0F4C90771C18F2B5B53A4C850C15FE@GVW0432EXB.americas.hpqcorp.net> From: Jonathan Ellis Date: Wed, 2 Dec 2009 12:32:15 -0600 Message-ID: Subject: Re: Persistently increasing read latency To: cassandra-user@incubator.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable We are using trunk. 0.5 beta / trunk is better than 0.4 at the 0.4 functionality and IMO is production ready (although you should always test first), but I would not yet rely on the new stuff (bootstrap, loadbalance, and moving nodes around in general). -Jonathan On Wed, Dec 2, 2009 at 12:26 PM, Adam Fisk wrote: > Helpful thread guys. In general, Jonathan, would you recommend > building from trunk for new deployments at our current snapshot in > time? Are you using trunk at Rackspace? > > Thanks. > > -Adam > > > On Tue, Dec 1, 2009 at 6:18 PM, Jonathan Ellis wrote: >> On Tue, Dec 1, 2009 at 7:31 PM, Freeman, Tim wrote: >>> Looking at the Cassandra mbean's, the attributes of ROW-MUTATION-STAGE = and ROW-READ-STAGE and RESPONSE-STAGE are all =A0less than 10. =A0MINOR-COM= PACTION-POOL reports 1218 pending tasks. >> >> That's probably the culprit right there. =A0Something is wrong if you >> have 1200 pending compactions. >> >> This is something that upgrading to trunk will help with right away >> since we parallelize compactions there. >> >> Another thing you can do is increase the memtable limits so you are >> not flushing + compacting so often with your insert traffic. >> >> -Jonathan >> > > > > -- > Adam Fisk > http://www.littleshoot.org | http://adamfisk.wordpress.com | > http://twitter.com/adamfisk >