Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8943558B3 for ; Thu, 12 May 2011 13:33:25 +0000 (UTC) Received: (qmail 6170 invoked by uid 500); 12 May 2011 13:33:23 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 6148 invoked by uid 500); 12 May 2011 13:33:23 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 6140 invoked by uid 99); 12 May 2011 13:33:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 May 2011 13:33:23 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [216.32.181.186] (HELO CH1EHSOBE001.bigfish.com) (216.32.181.186) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 May 2011 13:33:14 +0000 Received: from mail10-ch1-R.bigfish.com (216.32.181.168) by CH1EHSOBE001.bigfish.com (10.43.70.51) with Microsoft SMTP Server id 14.1.225.8; Thu, 12 May 2011 13:32:52 +0000 Received: from mail10-ch1 (localhost.localdomain [127.0.0.1]) by mail10-ch1-R.bigfish.com (Postfix) with ESMTP id 52B4A14C83F3 for ; Thu, 12 May 2011 13:32:52 +0000 (UTC) X-SpamScore: -9 X-BigFish: VPS-9(zzbb2cK1432Nzz1202hzzz2dh2a8h668h839h61h) X-Spam-TCS-SCL: 0:0 X-Forefront-Antispam-Report: KIP:(null);UIP:(null);IPVD:NLI;H:VA3DIAHUB046.RED001.local;RD:smtp801.microsoftonline.com;EFVD:NLI Received: from mail10-ch1 (localhost.localdomain [127.0.0.1]) by mail10-ch1 (MessageSwitch) id 1305207171128833_16922; Thu, 12 May 2011 13:32:51 +0000 (UTC) Received: from CH1EHSMHS035.bigfish.com (snatpool1.int.messaging.microsoft.com [10.43.68.245]) by mail10-ch1.bigfish.com (Postfix) with ESMTP id 12BE0668053 for ; Thu, 12 May 2011 13:32:51 +0000 (UTC) Received: from VA3DIAHUB046.RED001.local (65.55.171.153) by CH1EHSMHS035.bigfish.com (10.43.70.35) with Microsoft SMTP Server (TLS) id 14.1.225.8; Thu, 12 May 2011 13:32:50 +0000 Received: from [192.168.1.150] (69.70.138.86) by smtp.mail.microsoftonline.com (10.32.21.120) with Microsoft SMTP Server (TLS) id 8.3.83.0; Thu, 12 May 2011 06:32:43 -0700 Message-ID: <4DCBE176.2010200@wajam.com> Date: Thu, 12 May 2011 09:32:38 -0400 From: Gabriel Tataranu User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.17) Gecko/20110424 Thunderbird/3.1.10 MIME-Version: 1.0 To: "user@cassandra.apache.org" Subject: Re: Excessive allocation during hinted handoff References: <4DCADB98.1060600@wajam.com> In-Reply-To: Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit X-OriginatorOrg: wajam.com Greetings, > Just out of curiosity is this on the receiver or sender side? Looks like sender side, although the 2 nodes were replicating to each other so it's hard to tell. > > I have been wondering a bit if the hint playback could need some > adjustment. > There is potentially quite big differences on how much is sent per > throttle delay time depending on what your data looks like. > > Early 0.7 releases also built up hints very easily under load due to > nodes quickly getting marked as down due to gossip sharing the same > thread as many other operations. Like I said, cassandra was updated to 0.7.5 (latest build as of today) following the advice on IRC. There was no change in behavior. Best, Gabriel