Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 65246 invoked from network); 21 Apr 2010 18:13:52 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 21 Apr 2010 18:13:52 -0000 Received: (qmail 35602 invoked by uid 500); 21 Apr 2010 18:13:51 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 35566 invoked by uid 500); 21 Apr 2010 18:13:51 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 35558 invoked by uid 99); 21 Apr 2010 18:13:51 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Apr 2010 18:13:51 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [131.215.239.119] (HELO mail.alumni.caltech.edu) (131.215.239.119) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Apr 2010 18:13:43 +0000 Received: from localhost (dsl081-082-089.lax1.dsl.speakeasy.net [64.81.82.89]) by mail.alumni.caltech.edu (Postfix) with ESMTPSA id 768183F20E3; Wed, 21 Apr 2010 11:11:54 -0700 (PDT) X-DKIM: Sendmail DKIM Filter v2.8.2 mail.alumni.caltech.edu 768183F20E3 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=alumni.caltech.edu; s=enforce; t=1271873514; bh=aaImRI3lhPpalx0jWa6yYa0h7M/JkkwFeyFn1a5qoEQ=; h=Date:From:To:Subject:Message-ID:References:Mime-Version: Content-Type:Content-Transfer-Encoding:In-Reply-To; b=qkjRaYaASqEDz/Seroi+dXIIFE4jHg9wZmOrgbMu5KmhrxXtuMx4a41S1/vb7YTEV wlwen34ShMQMnouZrNikxsRb8fvysjCwF3ixtXksSEXWh+yA5A5k7z0TOVb2jDHMs2 4NQNoo/fYPnOXbhVnrz4WEy608xqY/25prCZ3exg= Date: Wed, 21 Apr 2010 11:11:53 -0700 From: Anthony Molinaro To: user@cassandra.apache.org Subject: Re: Cassandra 0.5.1 restarts slow Message-ID: <20100421181153.GE39306@alumni.caltech.edu> Mail-Followup-To: user@cassandra.apache.org References: <20100420215724.GA35209@alumni.caltech.edu> <20100421174547.GC39306@alumni.caltech.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.4.2.3i X-MailScanner-Information-Alumni: X-Alumni-MailScanner-ID: 768183F20E3.A9D2F X-MailScanner-Alumni: No Virii found X-Spam-Status-Alumni: not spam, SpamAssassin (not cached, score=-3.268, required 5, ALL_TRUSTED -1.80, BAYES_00 -2.60, DNS_FROM_OPENWHOIS 1.13, FH_DATE_PAST_20XX 0.00) X-MailScanner-From: anthonym@alumni.caltech.edu X-Virus-Checked: Checked by ClamAV on apache.org On Wed, Apr 21, 2010 at 12:52:32PM -0500, Jonathan Ellis wrote: > On Wed, Apr 21, 2010 at 12:45 PM, Anthony Molinaro > wrote: > >> as for why it backs up in the first place before the restart, you can > >> either (a) throttle writes [set your timeout lower, make your clients > >> back off temporarily when it gets a timeoutexception] > > > > What timeout is this? �Something in the thrift API or a cassandra > > configuration? > > the latter. iirc it is "RPCTimeout" Interesting, in the config I see 5000 So I thought that timeout was for inter-node communication not the thrift API, but I see how you probably consider both inter-node traffic and thrift traffic as clients. Does this RPC Timeout apply to both? Somewhat off-topic but relating to timeouts, is there any plans to tune the timeouts for Gossip nodes? EC2 network is horribly flakey, and I often see node go Dead, the come back a few seconds later, so just wondering if there's a way to tune the check to occur less frequently? -Anthony -- ------------------------------------------------------------------------ Anthony Molinaro