Return-Path: Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: (qmail 79554 invoked from network); 16 Oct 2010 13:53:10 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Oct 2010 13:53:10 -0000 Received: (qmail 10187 invoked by uid 500); 16 Oct 2010 13:53:08 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 10086 invoked by uid 500); 16 Oct 2010 13:53:08 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 10078 invoked by uid 99); 16 Oct 2010 13:53:07 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 16 Oct 2010 13:53:07 +0000 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jbellis@gmail.com designates 74.125.82.44 as permitted sender) Received: from [74.125.82.44] (HELO mail-ww0-f44.google.com) (74.125.82.44) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 16 Oct 2010 13:53:01 +0000 Received: by wwj40 with SMTP id 40so2251512wwj.25 for ; Sat, 16 Oct 2010 06:52:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=6wluHgwX4vSLwnll7/I2ekcoohtX8yJsjXSvqHu9+8w=; b=ePorBDXuZW1ntgQxRQioDRdGEiswsBAq6nRDsTnWHyZzQblrnyCC0F9Cgj3ZvfjueU F0DOpnkpubtmrzfPa0K52nLK/xUd96MYVRhbEzSJfmnlllC1dKJKxnZfj5aquPEWhhjc dXPscjLuSh1qSe6A752TSIuhSi3ilXDhMH/lU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=d5pvKBPTdeszKqJX3B9HJvYLT47YdIFYnOQFVNLFrFfa0UhotLSRm/ZLLa109MCA5G /WIbDKo3FGOG/jIRAz+jP69dlg3IvpgIcjH3lEKcN3Lixz64NN1Zy+TOPCGSawTV96vB VGPSBFYgWqynGPGvtxp6Lf7Z+iWlxzjjDR8hs= MIME-Version: 1.0 Received: by 10.216.71.85 with SMTP id q63mr2238648wed.53.1287237159153; Sat, 16 Oct 2010 06:52:39 -0700 (PDT) Received: by 10.216.52.16 with HTTP; Sat, 16 Oct 2010 06:52:38 -0700 (PDT) In-Reply-To: References: Date: Sat, 16 Oct 2010 08:52:38 -0500 Message-ID: Subject: Re: Read Latency From: Jonathan Ellis To: user Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Stack trace from cassandra log? On Sat, Oct 16, 2010 at 6:50 AM, Wayne wrote: > While doing a read I get a TApplicationException: Internal Error processi= ng > get_slice. > > On Fri, Oct 15, 2010 at 5:49 PM, Jonathan Ellis wrote= : >> >> On Fri, Oct 15, 2010 at 2:21 PM, Wayne wrote: >> > The optimization definitely shaved off some time. Now it is running >> > about 3x >> > CFSTATS reported time. Below are the logs. >> > >> > There is a ~300ms time frame after the last ResponseVerbHandler prior = to >> > the >> > resolver starting. Based on a quorum read the response resolver should >> > kick >> > after 2 reads come in correct? That would mean it waited 500ms before >> > starting. Where is this time going? >> >> It's going to deserialize the replies to see if it has both the data >> and enough digests to call resolve(). =A0Then resolve deserializes them >> a 2nd time, so there's an easy win there caching the first >> deserialize, in the patch attached. =A0(Applies on top of the previous >> one, which has been committed to the 0.6 svn branch at >> https://svn.apache.org/repos/asf/cassandra/branches/cassandra-0.6.) >> >> > There is still the 3+ second delay between the last 2 entries. Is this >> > the >> > thrift server? >> >> It's converting the reply from Cassandra's internal representation to >> thrift, and sending it to the client. =A0I suspect most of the time is >> the actual sending/waiting for the client to read part. =A0Patch 2 also >> includes a debug statement after the convert-to-thrift stage to >> verify. >> >> -- >> Jonathan Ellis >> Project Chair, Apache Cassandra >> co-founder of Riptano, the source for professional Cassandra support >> http://riptano.com > > --=20 Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com