Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of synfinatic@gmail.com
 designates 209.85.217.178 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEo-6+ReBZVYCbujXQtOzW9OnEFqd8tQd=3VxFOet7UGOvUt3g@mail.gmail.com>
References: 
 <CAEo-6+TFXNOb091ga51vUv8-iu6a-DEgvsymRBPgTP3-GmuAog@mail.gmail.com>
 <CANAZdzUC2zO-p7AnPyxe--vQeVh8UGPnvx5b+WrMkgxvQBYpBA@mail.gmail.com>
 <CAEo-6+SGaz-3QBjsj91vKtuqD-Kx+mL3y=3_CNHxbBRVd5Wi+A@mail.gmail.com>
 <CANAZdzWJNLT28KYEaNy=AekWo+PE+JhghzweDwJXkkDsrYj+mA@mail.gmail.com>
 <CAEo-6+ReBZVYCbujXQtOzW9OnEFqd8tQd=3VxFOet7UGOvUt3g@mail.gmail.com>
From: Aaron Turner <synfinatic@gmail.com>
Date: Thu, 12 Sep 2013 09:26:37 -0700
Message-ID: 
 <CANAZdzVKk8VqnwkovZqWiw1qunLdoUKDm4m59dHCfEOVZZPDfg@mail.gmail.com>
Subject: Re: VMs versus Physical machines
To: cassandra users <user@cassandra.apache.org>
Content-Type: multipart/alternative; boundary=001a11c36cdeef5cd304e63234e7

--001a11c36cdeef5cd304e63234e7
Content-Type: text/plain; charset=ISO-8859-1

On Thu, Sep 12, 2013 at 5:42 AM, Shahab Yunus <shahab.yunus@gmail.com>wrote:

> I admit about missing details. Sorry for that. The thing is that I was
> looking for guidance at the high-level so we can then sort out myself what
> fits our requirements and use-cases (mainly because we are at the stage
> that they could be molded according to hardware and software
> limitations/features.) So, for example if it is recommended that ' for
> heavy reads physical is better etc.')
>
> Anyway, just to give you a quick recap:
> 1- Cassandra 1.2.8
> 2- Row is a unique userid and can have one or more columns. Every cell is
> basically a blob of data (using Avro.) All information is in this one
> table. No joins or other access patters.
> 3- Writes can be both in bulk (which will of course has less strict
> performance requirements) or real-time. All writes would be at the per
> userid, hence, row level and constitute of adding new rows (of course with
> some column values) or updating specific cells (column) of the existing row.
> 4- Reads are per userid i.e. row and 90% of the time random reads for a
> user. Rather than in bulk.
> 5- Both reads and write interfaces are exposed through REST service as
> well as direct Java client API.
> 6- Reads and writes, as mentioned in 3&4 can be for 1 or more columns at a
> time.
>
> Regards,
> Shahab
>


Your total data set size and number of reads/writes per-second are the
important things here.  Also how sensitive are you to latency spikes (which
tends to happen with VM's)?

Long story short, the safest option is always physical IMHO.  Use VM/cloud
if you need to use VM/cloud for some reason (like all the other servers
talking to Cassandra are also in AWS for example).  Cloud can work (Netflix
uses Cassandra on AWS), but your performance will be a lot more consistent
on physical hardware and Cassandra like all databases likes lots of RAM
(although this can be offset some with SSD's) which tends to be expensive
in the cloud.


-- 
Aaron Turner
http://synfin.net/         Twitter: @synfinatic
https://github.com/synfinatic/tcpreplay - Pcap editing and replay tools for
Unix & Windows
Those who would give up essential Liberty, to purchase a little temporary
Safety, deserve neither Liberty nor Safety.
    -- Benjamin Franklin

--001a11c36cdeef5cd304e63234e7
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><br><div class=3D"gmail_extra"><br><div class=3D"gmail_quo=
te">On Thu, Sep 12, 2013 at 5:42 AM, Shahab Yunus <span dir=3D"ltr">&lt;<a =
href=3D"mailto:shahab.yunus@gmail.com" target=3D"_blank">shahab.yunus@gmail=
.com</a>&gt;</span> wrote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-=
left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p=
adding-left:1ex"><div dir=3D"ltr">I admit about missing details. Sorry for =
that. The thing is that I was looking for guidance at the high-level so we =
can then sort out myself what fits our requirements and use-cases (mainly b=
ecause we are at the stage that they could be molded according to hardware =
and software limitations/features.) So, for example if it is recommended th=
at &#39; for heavy reads physical is better etc.&#39;)<div>


<br></div><div>Anyway, just to give you a quick recap:</div><div>1- Cassand=
ra 1.2.8</div><div>2- Row is a unique userid and can have one or more colum=
ns. Every cell is basically a blob of data (using Avro.) All information is=
 in this one table. No joins or other access patters.</div>


<div>3- Writes can be both in bulk (which will of course has less strict pe=
rformance requirements) or real-time. All writes would be at the per userid=
, hence, row level and constitute of adding new rows (of course with some c=
olumn values) or updating specific cells (column) of the existing row.</div=
>


<div>4- Reads are per userid i.e. row and 90% of the time random reads for =
a user. Rather than in bulk.=A0</div><div>5- Both reads and write interface=
s are exposed through REST service as well as direct Java client API.</div>


<div>6- Reads and writes, as mentioned in 3&amp;4 can be for 1 or more colu=
mns at a time.</div><div><br></div><div>Regards,</div><div>Shahab</div></di=
v></blockquote><div><br></div><div><br></div><div>Your total data set size =
and number of reads/writes per-second are the important things here. =A0Als=
o how sensitive are you to latency spikes (which tends to happen with VM=
9;s)?</div>

<div><br></div><div>Long story short, the safest option is always physical =
IMHO. =A0Use VM/cloud if you need to use VM/cloud for some reason (like all=
 the other servers talking to Cassandra are also in AWS for example). =A0Cl=
oud can work (Netflix uses Cassandra on AWS), but your performance will be =
a lot more consistent on physical hardware and Cassandra like all databases=
 likes lots of RAM (although this can be offset some with SSD&#39;s) which =
tends to be expensive in the cloud.</div>

<div><br></div><div><br></div><div><br></div><div><br class=3D"">--=A0<br c=
lear=3D"all"><div><div dir=3D"ltr">Aaron Turner<br><a href=3D"http://synfin=
.net/" target=3D"_blank">http://synfin.net/</a>=A0 =A0 =A0 =A0=A0 Twitter: =
@synfinatic<br><a href=3D"https://github.com/synfinatic/tcpreplay" target=
=3D"_blank">https://github.com/synfinatic/tcpreplay</a>=A0- Pcap editing an=
d replay tools for Unix &amp; Windows<br>

Those who would give up essential Liberty, to purchase a little temporary=
=A0<br>Safety, deserve neither Liberty nor Safety.=A0=A0<br>=A0 =A0 -- Benj=
amin Franklin<br><br></div></div></div></div></div></div>

--001a11c36cdeef5cd304e63234e7--