Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 158A311217 for ; Tue, 9 Sep 2014 19:53:16 +0000 (UTC) Received: (qmail 50579 invoked by uid 500); 9 Sep 2014 19:53:11 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 50537 invoked by uid 500); 9 Sep 2014 19:53:11 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 50527 invoked by uid 99); 9 Sep 2014 19:53:11 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Sep 2014 19:53:11 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_HELO_PASS,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of paolo.crosato@targaubiest.com designates 213.199.154.83 as permitted sender) Received: from [213.199.154.83] (HELO emea01-db3-obe.outbound.protection.outlook.com) (213.199.154.83) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Sep 2014 19:52:45 +0000 Received: from AM3PR03MB530.eurprd03.prod.outlook.com (10.242.109.154) by AM3PR03MB0758.eurprd03.prod.outlook.com (25.160.210.24) with Microsoft SMTP Server (TLS) id 15.0.1024.12; Tue, 9 Sep 2014 19:52:43 +0000 Received: from AM3PR03MB531.eurprd03.prod.outlook.com (10.242.109.155) by AM3PR03MB530.eurprd03.prod.outlook.com (10.242.109.154) with Microsoft SMTP Server (TLS) id 15.0.1024.12; Tue, 9 Sep 2014 19:52:42 +0000 Received: from AM3PR03MB531.eurprd03.prod.outlook.com ([10.242.109.155]) by AM3PR03MB531.eurprd03.prod.outlook.com ([10.242.109.155]) with mapi id 15.00.1024.012; Tue, 9 Sep 2014 19:52:42 +0000 From: Paolo Crosato To: "user@cassandra.apache.org" Subject: RE: hardware sizing for cassandra Thread-Topic: hardware sizing for cassandra Thread-Index: AQHPzFhc3vopB+nQmUqGX9C0Zr6wRpv5Lx4AgAADq4M= Date: Tue, 9 Sep 2014 19:52:42 +0000 Message-ID: <1410292361656.15345@targaubiest.com> References: ,<5BDBBC4B-8A9D-4928-BAAD-BCF7D21C4565@blackbirdit.com> In-Reply-To: <5BDBBC4B-8A9D-4928-BAAD-BCF7D21C4565@blackbirdit.com> Accept-Language: it-IT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [79.45.246.161] x-microsoft-antispam: BCL:0;PCL:0;RULEID:;UriScan:;UriScan:; x-forefront-prvs: 0329B15C8A x-forefront-antispam-report: SFV:NSPM;SFS:(6009001)(24454002)(377454003)(57704003)(51704005)(199003)(189002)(36756003)(54356999)(4396001)(76176999)(105586002)(2656002)(106116001)(50986999)(20776003)(74502001)(101416001)(64706001)(117636001)(90102001)(81542001)(80022001)(66066001)(81342001)(106356001)(31966008)(74662001)(19580405001)(83322001)(19580395003)(85852003)(21056001)(95666004)(76482001)(46102001)(85306004)(86362001)(92566001)(92726001)(99396002)(83072002)(110136001)(97736003)(2351001)(107886001)(2501002)(79102001)(87936001)(107046002)(77982001);DIR:OUT;SFP:;SCL:1;SRVR:AM3PR03MB530;H:AM3PR03MB531.eurprd03.prod.outlook.com;FPR:;MLV:sfv;PTR:InfoNoRecords;A:0;MX:1;LANG:en; Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Microsoft-Antispam: BCL:0;PCL:0;RULEID:; X-OriginatorOrg: targaubiest.com X-Virus-Checked: Checked by ClamAV on apache.org Every node should have at least 4 cores, with a maximum of 8. Memory should= n't be higher than 32g, 16gb is good for a start. Every node should be a ph= isical machine, not a virtual one, or at least a virtual machine with an ss= d hd subsystem. The disk subsystem should be directly connected to the mach= ine, no sans or fiber channel between. Cassandra is cpu and io bounded, so = you should get the maximum io speed and a reasonable number of cores.=0A= =0A= Number of nodes should be 3 at least with replication factor of 2. You shou= ld prefer more less powerful nodes then fewer more powerful nodes.=0A= =0A= Disk size depends on your workload, although you should always keep 50% of = the disk free in the case repair sessions requires space, or perform sub ra= nge repairs.=0A= =0A= In my experience a 1GB link between nodes is ok, but the less lag the bette= r.=0A= =0A= Summing up if you need to save some money, get 4 cores and 16 gb or ram, 32= is rarely needed and 64 a waste. 8 cores would probably be too much with 1= 000 writes a second.=0A= =0A= Paolo=0A= =0A= =0A= ...........................................................................= .............=0A= Paolo Crosato=0A= Software engineer/Custom Solutions=0A= =0A= =0A= ________________________________________=0A= Da: Chris Lohfink =0A= Inviato: marted=EC 9 settembre 2014 21.26=0A= A: user@cassandra.apache.org=0A= Oggetto: Re: hardware sizing for cassandra=0A= =0A= It depends. Ultimately your load is low enough a single node can probably = handle it so you kinda want a "minimum" cluster. Different people have dif= ferent thoughts on what this means - I would recommend 5-6 nodes with a 3 r= eplication factor. (say m1.xlarge, or c3.2xlarge striped ephemerals, I lik= e i2's but kinda overkill here). Nodes with less then 16gb of ram wont las= t long so should really start around there.=0A= =0A= Chris=0A= =0A= On Sep 9, 2014, at 11:02 AM, Oleg Ruchovets wrote:= =0A= =0A= > Hi ,=0A= > Where can I find the document with best practices about sizing for cas= sandra deployment?=0A= > We have 1000 writes / reads per second. record size 1k.=0A= >=0A= > Questions:=0A= > 1) how many machines do we need?=0A= > 2) how many ram ,disc size / type?=0A= > 3) What should be network?=0A= >=0A= > I understand that hardware is very depends on data distribution and acces= s pattern and other criteria, but I still want to believe that there is a b= est practice :-)=0A= >=0A= > Thanks=0A= > Oleg.=0A= =0A=