Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 53A95200C80 for ; Thu, 11 May 2017 04:54:12 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 522C0160BB4; Thu, 11 May 2017 02:54:12 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 71B6E160B9C for ; Thu, 11 May 2017 04:54:11 +0200 (CEST) Received: (qmail 15093 invoked by uid 500); 11 May 2017 02:54:09 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 15079 invoked by uid 99); 11 May 2017 02:54:09 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 May 2017 02:54:09 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 56702C1E98 for ; Thu, 11 May 2017 02:54:09 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.479 X-Spam-Level: ** X-Spam-Status: No, score=2.479 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=imagine-orb-com.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id waora1VNRju0 for ; Thu, 11 May 2017 02:54:07 +0000 (UTC) Received: from mail-wm0-f49.google.com (mail-wm0-f49.google.com [74.125.82.49]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id BBA825F202 for ; Thu, 11 May 2017 02:54:06 +0000 (UTC) Received: by mail-wm0-f49.google.com with SMTP id 142so19685664wma.1 for ; Wed, 10 May 2017 19:54:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=imagine-orb-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=EzNm/mdmYLNRvQ0xwYAfL1ILTDulk0hjtuooFBJ9cMA=; b=n7Kml+5FQXtXQZYSIG7/JvPzFfvbtt4465HdehWU8qQxivGYVy7U8Q50rkyuFCE1/b r9Dm7FbYLGmb5ScyFcfwAekSvk3+Muw6tl4u/K2f/2Xc1OSqFcRagdomBAOnSzzr9POn CiOAd3WQZhwmxjZQ0ETlriIbsydvhw0S7ub0GBH3VSQr0cY2pW+vzpqMOfsDyjkZ9/wy NQsO+ZU9GX2aHPGhvnYTySYeQzum6TMiedi39TUOTHiajTngNVnjNqGExclhlmPSq0Jg uizlwM+6IqS6tfoQ1ySIFKpZAC2aaXiG9uhTkOFV8ep6pd3U1bGRkoVEUHzEyDMfK+oo PluA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=EzNm/mdmYLNRvQ0xwYAfL1ILTDulk0hjtuooFBJ9cMA=; b=NY1O2Ir914MyTSC+W4pq26EsQN47yOW7IN5QJ0z2qepD879g3hRKlWO+KfL6WWW98D 84gkia4FPeEDfYq8pO9YXBtdylByAl4MhWqCGZOVAKSb6eiltO0rOYomi/rJ6ZWpZcbj dbmH9Xose6FV17+Dr3sOtLtYSC7kYOohb+flMcjAJtr22/L+hjgHcrdSzuZKa4CGZBpj zxSclEtUUKUF9Ip1rp2lvqnGw3lrZmCiob82pTZZm6pLE2OvJNN6kRqxodFnxcy42NAP NVCyLVPn4SUOHZDZL4rFDPkhLJxu9/p0xePsgUNg8jklOESwo4kkmJxpa1uOuCH2Opst h2ZQ== X-Gm-Message-State: AODbwcDc0XUojlBZY+Id9oouKuv5gFp9j8OChjtrDOFPghEpgaQfnDMW skv2cznHQS3RVOVfml5hjW5fFe7qnA== X-Received: by 10.28.54.206 with SMTP id y75mr5334069wmh.72.1494471246344; Wed, 10 May 2017 19:54:06 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.8.14 with HTTP; Wed, 10 May 2017 19:54:05 -0700 (PDT) In-Reply-To: References: From: Yuji Ito Date: Thu, 11 May 2017 11:54:05 +0900 Message-ID: Subject: Re: Difference between yum and git To: Joaquin Casares Cc: user@cassandra.apache.org Content-Type: multipart/alternative; boundary=001a11435ed8c40ac3054f36b397 archived-at: Thu, 11 May 2017 02:54:12 -0000 --001a11435ed8c40ac3054f36b397 Content-Type: text/plain; charset=UTF-8 Hi Joaquin, > Were both tests run from the same machine at close the same time? Yes. I run the both tests within 30 min. I retried them today. The result was the same as yesterday. The test run on the same instances and the same Java. Thanks, Yuji On Thu, May 11, 2017 at 3:27 AM, Joaquin Casares wrote: > Hi Yuji, > > Were both tests run from the same machine at close the same time? If not, > noisy neighbors may be affecting your performance on different AWS > instances. > > You should verify that you're using the same version of Java during both > tests. > > Also, ensure that you're using the same test instance (that is not running > Cassandra) to connect to both Cassandra clusters. > > Cheers, > > Joaquin > > Joaquin Casares > Consultant > Austin, TX > > Apache Cassandra Consulting > http://www.thelastpickle.com > > On Wed, May 10, 2017 at 5:01 AM, Yuji Ito wrote: > >> Hi all, >> >> I'm trying a simple performance test. >> The test requests select operations (CL.SERIAL or CL.QUORUM) by >> increasing the number of threads. >> There is the difference of the performance between C* installed by yum >> and C* which I built by myself. >> What causes the difference? >> >> I use C* 2.2.8. >> One of them was installed by yum (# yum install cassandra22). >> Another was acquired by git from https://github.com/apache/cass >> andra/tree/cassandra-2.2.8 and built it by myself. >> I changed cassandra.yaml to set `commitlog_sync: batch` and >> `commitlog_sync_batch_window_in_ms: 2`. >> >> My environment: >> - a cluster has 3 nodes >> - node: AWS EC2 m4.large with 200 IOPS EBS volume >> - Replication Factor: 3 >> - 10000 rows >> >> Result: >> ** yum >> ==== select (CL.SERIAL) ==== >> threads operations/sec >> 1 188 >> 2 156 >> 4 434 >> 8 396 >> 16 837 >> 32 1176 >> 64 2206 >> 128 4115 >> 256 7272 >> >> ** git >> ==== select (CL.SERIAL) ==== >> threads operations/sec >> 1 192 >> 2 162 >> 4 264 >> 8 446 >> 16 733 >> 32 1114 >> 64 1715 >> 128 2776 >> 256 3920 >> >> ** yum >> ==== select (CL.QUORUM) ==== >> threads operations/sec >> 1 434 >> 2 909 >> 4 1481 >> 8 1904 >> 16 2666 >> 32 3106 >> 64 3555 >> 128 5000 >> 256 9014 >> >> ** git >> ==== select (CL.QUORUM) ==== >> threads operations/sec >> 1 666 >> 2 1538 >> 4 2500 >> 8 3333 >> 16 4210 >> 32 5333 >> 64 6597 >> 128 7356 >> 256 8075 >> >> Thanks, >> Yuji >> >> > --001a11435ed8c40ac3054f36b397 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Joaquin,

>=C2=A0Were both tests run from the same machine at close the same= time?
Yes. I run the bot= h tests within 30 min.
I = retried them today. The result was the same as yesterday.
=
The test run on the same instances and the same Java.

Thanks,
Yuji


On Thu, May 11= , 2017 at 3:27 AM, Joaquin Casares <joaquin@thelastpickle.com&= gt; wrote:
Hi Yuj= i,

Were both tests run from the same machine at close th= e same time? If not, noisy neighbors may be affecting your performance on d= ifferent AWS instances.

You should verify that you= 're using the same version of Java during both tests.

Also, ensure that you're using the same test instance (that is = not running Cassandra) to connect to both Cassandra clusters.
Cheers,

Joaquin

=
Joaquin Casares
Consultant
Austin, TX

Apache Cassandra Consulting
http://www.the= lastpickle.com

On Wed, May 10, 2017 at 5:01 AM, Yuji Ito <yuji@imagine-orb.com> wrote:
Hi all,

I'm trying a simple pe= rformance test.
The test requests select operations (CL.SERIAL or= CL.QUORUM) by increasing the number of threads.
There is the dif= ference of the performance between C* installed by yum and C* which I built= by myself.
What causes the difference?

= I use C* 2.2.8.
One of them was installed by yum (# yum install c= assandra22).
Another was acquired by git from https:/= /github.com/apache/cassandra/tree/cassandra-2.2.8 and built it by = myself.
I changed cassandra.yaml to set `commitlog_sync: batch` a= nd `commitlog_sync_batch_window_in_ms: 2`.

My= environment:
- a cluster has 3 nodes
- node: AWS EC2 m= 4.large with 200 IOPS EBS volume
- Replication Factor: 3
- 10000 rows

Result:
*= * yum
=3D=3D=3D=3D select (CL.SERIAL) =3D=3D=3D=3D
thre= ads =C2=A0operations/sec
1 =C2=A0 188
2 =C2=A0 156
4 =C2=A0 434
8 =C2=A0 396
16 =C2=A0837
= 32 =C2=A01176
64 =C2=A02206
128 4115
256 7272=

** git
=3D=3D=3D=3D select (= CL.SERIAL) =3D=3D=3D=3D
threads =C2=A0operations/sec
1 = =C2=A0 192
2 =C2=A0 162
4 =C2=A0 264
8 =C2=A0= 446
16 =C2=A0733
32 =C2=A01114
64 =C2=A01715=
128 2776
256 3920

** yum=
=3D=3D=3D=3D select (CL.QUORUM) =3D=3D=3D=3D
threads = =C2=A0operations/sec
1 =C2=A0 434
2 =C2=A0 909
4 =C2=A0 1481
8 =C2=A0 1904
16 =C2=A02666
3= 2 =C2=A03106
64 =C2=A03555
128 5000
256 9014<= /div>

** git
=3D=3D=3D=3D select (CL.QUO= RUM) =3D=3D=3D=3D
threads =C2=A0operations/sec
1 =C2=A0= 666
2 =C2=A0 1538
4 =C2=A0 2500
8 =C2=A0 333= 3
16 =C2=A04210
32 =C2=A05333
64 =C2=A06597
128 7356
256 8075

Thanks,=
Yuji



--001a11435ed8c40ac3054f36b397--