Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 01271D577 for ; Tue, 21 Aug 2012 09:37:53 +0000 (UTC) Received: (qmail 86724 invoked by uid 500); 21 Aug 2012 09:37:50 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 86595 invoked by uid 500); 21 Aug 2012 09:37:50 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 86579 invoked by uid 99); 21 Aug 2012 09:37:50 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Aug 2012 09:37:50 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: local policy) Received: from [208.113.200.5] (HELO homiemail-a42.g.dreamhost.com) (208.113.200.5) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Aug 2012 09:37:45 +0000 Received: from homiemail-a42.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a42.g.dreamhost.com (Postfix) with ESMTP id A41D768C05D for ; Tue, 21 Aug 2012 02:37:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=thelastpickle.com; h=from :content-type:message-id:mime-version:subject:date:references:to :in-reply-to; s=thelastpickle.com; bh=J2IBcybO7zv9nh7CsdPYed7Phs 8=; b=cIEH1YqmQGHawkqJisQhZjnamGrBjqQ8I6/7k3WAumFL5lpHXSW5K1Djxe dVrWRFS9eIjQtV6uDudZCbReWt/QLsKuhbne70wafBTTJzKXltUZVmSvw3BUUsIL mwlCL/hX3ofDmxQt4DaFS/ERcRXQxoSGMPPQX4p+W4TGOwcTQ= Received: from [172.16.1.10] (unknown [203.86.207.101]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: aaron@thelastpickle.com) by homiemail-a42.g.dreamhost.com (Postfix) with ESMTPSA id 1F00C68C05B for ; Tue, 21 Aug 2012 02:37:23 -0700 (PDT) From: aaron morton Content-Type: multipart/alternative; boundary="Apple-Mail=_BA406957-091C-440E-A623-C028266E1715" Message-Id: <0CD1B6D8-A1A8-4A26-A956-6F40B6C4D4AF@thelastpickle.com> Mime-Version: 1.0 (Mac OS X Mail 6.0 \(1485\)) Subject: Re: Why so slow? Date: Tue, 21 Aug 2012 21:37:22 +1200 References: To: user@cassandra.apache.org In-Reply-To: X-Mailer: Apple Mail (2.1485) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail=_BA406957-091C-440E-A623-C028266E1715 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 I did a talk on server side latency at Cassandra Summit 12 the other = week=20 http://www.datastax.com/events/cassandrasummit2012/presentations=20 If you want to do some baseline tests think about: multiple clients, = batch calls with maybe 10's of rows, connection pooling.=20 There is a stress tool in source distribution that maybe of help.=20 Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 21/08/2012, at 4:16 AM, "Hiller, Dean" wrote: > Be careful on bulk as cassandra takes a bit longer to process. It was = faster not doing too many rows at a time multithreaded in our = performance testing and if I remember Aaron Morton might have told me = that as well. >=20 > Definitely use the cassandra bulk testing tool as well. I used that = and compared it to my tool until I got my tool in par with their tool = and you can post the numbers for the cassandra bulk testing tool and I = know there was someone on this list who told me the expected = writes/ms(it was probably Aaron as well). >=20 > Later, > Dean >=20 > From: Carlos Carrasco = > > Reply-To: = "user@cassandra.apache.org" = > > Date: Monday, August 20, 2012 10:03 AM > To: "user@cassandra.apache.org" = > > Subject: Re: Why so slow? >=20 > Are you inserting in bulk? Try to increase the amount of mutations you = send in a single batch, otherwise you are just measuring the TCP = roundtrip time. >=20 > On 20 August 2012 17:36, Peter Morris = > wrote: > My misunderstanding, thanks for correcting me! >=20 >=20 > On Mon, Aug 20, 2012 at 4:32 PM, Hiller, Dean = > wrote: > There is latency and throughput. These are two totally different = things even for MySQL. If you are single threaded, each request (even = with MySql) has to be delayed by 1ms or whatever your ping time is. To = fully utilize a 1Gps bandwidth, you NEED to be multithreaded or you are = wasting bandwidth=85and even then, you probably waste bandwidth as one = CPU can't always keep up with keeping the pipe filled. >=20 >=20 >=20 --Apple-Mail=_BA406957-091C-440E-A623-C028266E1715 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 I did = a talk on server side latency at Cassandra Summit 12 the other = week 

If you want to do some baseline tests think = about: multiple clients, batch calls with maybe 10's of rows, connection = pooling. 

There is a stress tool  in = source distribution that maybe of = help. 

Cheers


<= /div>
http://www.thelastpickle.com

On 21/08/2012, at 4:16 AM, "Hiller, Dean" <Dean.Hiller@nrel.gov> = wrote:

Be careful on bulk as cassandra takes a bit longer to = process.  It was faster not doing too many rows at a time = multithreaded in our performance testing and if I remember Aaron Morton = might have told me that as well.

Definitely use the cassandra = bulk testing tool as well.  I used that and compared it to my tool = until I got my tool in par with their tool and you can post the numbers = for the cassandra bulk testing tool and I know there was someone on this = list who told me the expected writes/ms(it was probably Aaron as = well).

Later,
Dean

From: Carlos Carrasco <carlos.carrasco@groupalia.co= m<mailto:carlos.carrasco@group= alia.com>>
Reply-To: "user@cassandra.apache.org<= ;mailto:user@cassandra.apache.org= >" <user@cassandra.apache.org<= ;mailto:user@cassandra.apache.org= >>
Date: Monday, August 20, 2012 10:03 AM
To: "user@cassandra.apache.org<= ;mailto:user@cassandra.apache.org= >" <user@cassandra.apache.org<= ;mailto:user@cassandra.apache.org= >>
Subject: Re: Why so slow?

Are you inserting in = bulk? Try to increase the amount of mutations you send in a single = batch, otherwise you are just measuring the TCP roundtrip = time.

On 20 August 2012 17:36, Peter Morris <mrpmorris@gmail.com<mailto:mrpmorris@gmail.com>>= wrote:
My misunderstanding, thanks for correcting me!


On = Mon, Aug 20, 2012 at 4:32 PM, Hiller, Dean <Dean.Hiller@nrel.gov<mailto:Dean.Hiller@nrel.gov>&g= t; wrote:
There is latency and throughput.  These are two = totally different things even for MySQL.  If you are single = threaded, each request (even with MySql) has to be delayed by 1ms or = whatever your ping time is.  To fully utilize a 1Gps bandwidth, you = NEED to be multithreaded or you are wasting bandwidth=85and even then, = you probably waste bandwidth as one CPU can't always keep up with = keeping the pipe = filled.




= --Apple-Mail=_BA406957-091C-440E-A623-C028266E1715--