Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D19756F3F for ; Tue, 14 Jun 2011 15:17:08 +0000 (UTC) Received: (qmail 8598 invoked by uid 500); 14 Jun 2011 15:17:06 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 8569 invoked by uid 500); 14 Jun 2011 15:17:06 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 8561 invoked by uid 99); 14 Jun 2011 15:17:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Jun 2011 15:17:06 +0000 X-ASF-Spam-Status: No, hits=3.5 required=5.0 tests=HTML_MESSAGE,SPF_PASS,URI_HEX X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [194.171.77.166] (HELO grnms101.ib-groep.nl) (194.171.77.166) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Jun 2011 15:16:59 +0000 Received: from unknown (HELO GRNMS004.IBGroep.local) ([172.30.254.196]) by grnms101.ibgroep.local with ESMTP; 14 Jun 2011 17:16:38 +0200 Received: from GRNMS003.IBGroep.local ([172.30.254.191]) by GRNMS004.IBGroep.local with Microsoft SMTPSVC(6.0.3790.4675); Tue, 14 Jun 2011 17:16:38 +0200 Received: from GRNMS002.IBGroep.local ([172.30.254.184]) by GRNMS003.IBGroep.local with Microsoft SMTPSVC(6.0.3790.4675); Tue, 14 Jun 2011 17:16:38 +0200 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01CC2AA6.0E7B3E25" Subject: Cassandra scaling problem in virtualized environment Date: Tue, 14 Jun 2011 17:16:38 +0200 Message-ID: <27BDF33DF4FBD74D89FB7DC288D781C5117CEF65@GRNMS002.IBGroep.local> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Cassandra scaling problem in virtualized environment Thread-Index: Acwqpg4zTCu4KZRRQRW0m07ONER1Ug== From: "Schuilenga, Jan Taeke" To: X-OriginalArrivalTime: 14 Jun 2011 15:16:38.0532 (UTC) FILETIME=[0EA1BC40:01CC2AA6] X-Virus-Checked: Checked by ClamAV on apache.org This is a multi-part message in MIME format. ------_=_NextPart_001_01CC2AA6.0E7B3E25 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All,=20 We are having issues testing Cassandra in a virtualized environment (Vmware ESX).=20 Our challenge is to combine a high number of concurrent users with a very low maximum response time.=20 Immediately we ran into a problem with scalability where our performance (Trx per sec) unexpectedly degrades after adding nodes without overcommitting host cpu resources too much as far as we can tell. Therefore we are looking for bestpractices or anybody with experiences with cassandra in a similar environment to help us. So far we only found the following article which hasn't helped so far: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Node-ad ded-no-performance-boost-are-the-tokens-correct-td6228872.html Our current test setup using the java version of the cassandra load tool consists of: Hardware: Vmware ESX cluster with IBM 3850 (4x dual core cpu) Hosts on Compellent FC SAN for storage=20 Cassandra: 3-6 node 2vCpu Centos guest boxes (RF=3D2)=20 Jan-Taeke Schuilenga ------_=_NextPart_001_01CC2AA6.0E7B3E25 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Cassandra scaling problem in virtualized environment

Hi All,

We are having = issues testing Cassandra in a virtualized environment (Vmware ESX). =
Our challenge is = to combine a  high number of concurrent users with a very low = maximum response time.
Immediately we = ran into a problem with scalability where our performance (Trx per sec) = unexpectedly degrades after adding nodes without overcommitting host cpu = resources too much as far as we can tell.

Therefore we are = looking for bestpractices or anybody with experiences with cassandra in = a similar environment to help us.

So far we only = found the following article which hasn’t helped so = far:
http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/N= ode-added-no-performance-boost-are-the-tokens-correct-td6228872.html

Our current test = setup using the java version of the cassandra load tool consists = of:
Hardware: Vmware = ESX cluster with IBM 3850 (4x dual core cpu) Hosts on Compellent FC SAN = for storage
Cassandra: 3-6 = node 2vCpu Centos guest boxes (RF=3D2)

Jan-Taeke = Schuilenga

------_=_NextPart_001_01CC2AA6.0E7B3E25--