Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of dipidi@gmail.com designates
 74.125.82.44 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CA+nPnMzmJXwQnjNQmh6oQb3YDemztYZ5WXPf=R-ohTV+MH3UNw@mail.gmail.com>
References: 
 <CAN3gsOw_yUi6nODbUV6vks0rCJBS5qBAdNhKsDe3vJM6oSJ+OA@mail.gmail.com>
	<CA+nPnMzmJXwQnjNQmh6oQb3YDemztYZ5WXPf=R-ohTV+MH3UNw@mail.gmail.com>
Date: Sun, 20 Nov 2011 23:03:47 +0200
Message-ID: 
 <CAN3gsOxaTZisMWijSt7oCbiALWgjL_mhHyQ8cFY02i5AJsBL6A@mail.gmail.com>
Subject: Re: data agility
From: "Dotan N." <dipidi@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=f46d0444e939040ae504b230e844

--f46d0444e939040ae504b230e844
Content-Type: text/plain; charset=ISO-8859-1

Thanks David.
Stephen: thanks for the tip, we can run a recommended configuration, so
that wouldn't be an issue. I guess I can focus that my questions are on
complexity of development.

After digesting David's answer, I guess my follow up questions would be
- how would you process data in a cassandra cluster, typically? via one-off
coded offline jobs?
- how easy is map/reduce on existing data (just looked at brisk but it may
be unrelated, any case, not too much written about it)
- how would you do analytics over a cassandra cluster
- given the common examples of time-series, how would you recommend to
aggregate (sum, avg, facet) and provide statistics over the collected data?
for example if it were kinds of logs and you'd like to group all of certain
fields in it, or provide a histogram over it.

Thanks!


--
Dotan, @jondot <http://twitter.com/jondot>


On Sun, Nov 20, 2011 at 10:32 PM, Stephen Connolly <
stephen.alan.connolly@gmail.com> wrote:

> if your startup is bootstrapping then cassandra is sometimes to heavy to
> start with.
>
> i.e. it needs to be fed ram... you're not going to seriously run it in
> less than 1gb per node... that level of ram commitment can be too much
> while bootstrapping.
>
> if your startup has enough cash to pay for 3-5 recommended spec (see wiki)
> nodes to be up 24/7 then cassandra is a good fit...
>
> a friend of mine is bootstrapping a startup and had to drop back to mysql
> while he finds his pain points and customers... he knows he will end up
> jumping back to cassandra when he gets enough customers (or a VC) but for
> now the running costs are too much to pay from his own pocket... note that
> the jdbc driver and cql will make jumping back easy for him (as he still
> tests with c*... just runs at present against mysql.... nuts eh!)
>
> - Stephen
>
> ---
> Sent from my Android phone, so random spelling mistakes, random nonsense
> words and other nonsense are a direct result of using swype to type on the
> screen
> On 20 Nov 2011 19:07, "Dotan N." <dipidi@gmail.com> wrote:
>
>> Hi all,
>> my question may be more philosophical than related technically
>> to Cassandra, but please bear with me.
>>
>> Given that a young startup may not know its product full at the early
>> stages, but that it definitely points to ~200M users,
>> would Cassandra will be the right way to go?
>>
>> That is, the requirement is for a large data store, that can move with
>> product changes and requirements swiftly.
>>
>> Given that in Cassandra one thinks hard about the queries, and then
>> builds a model to suit it best, I was thinking of
>> this situation as problematic.
>>
>> So here are some questions:
>>
>> - would it be wiser to start with a more agile data store (such as
>> mongodb) and then progress onto Cassandra, when the product itself
>> solidifies?
>> - given that we start with Cassandra from the get go, what is a common
>> (and quick in terms of development) way or practice to change data, change
>> schemas, as the product evolves?
>> - is it even smart to start with Cassandra? would only startups whose
>> core business is big data start with it from the get go?
>> - how would you do map/reduce with Cassandra? how agile is that? (for
>> example, can you run map/reduce _very_ frequently?)
>>
>> Thanks!
>>
>> --
>> Dotan, @jondot <http://twitter.com/jondot>
>>
>>

--f46d0444e939040ae504b230e844
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Thanks David.<div>Stephen: thanks for the tip, we can run =
a recommended configuration, so that wouldn&#39;t be an issue. I guess I ca=
n focus that my questions are on complexity of development.</div><div><br>
</div><div>After digesting David&#39;s answer, I guess my follow up questio=
ns would be=A0</div><div>- how would you process data in a cassandra cluste=
r, typically? via one-off coded offline jobs?=A0</div><div>- how easy is ma=
p/reduce on existing data (just looked at brisk but it may be unrelated, an=
y case, not too much written about it)</div>
<div>- how would you do analytics over a cassandra cluster</div><div>- give=
n the common examples of time-series, how would you recommend to aggregate =
(sum, avg, facet) and provide statistics over the collected data? for examp=
le if it were kinds of logs and you&#39;d like to group all of certain fiel=
ds in it, or provide a histogram over it.</div>
<div><br></div><div>Thanks!</div><div><br></div><div><br clear=3D"all"><div=
 dir=3D"ltr">--<div>Dotan,=A0<a href=3D"http://twitter.com/jondot" target=
=3D"_blank">@jondot</a></div></div><br>
<br><br><div class=3D"gmail_quote">On Sun, Nov 20, 2011 at 10:32 PM, Stephe=
n Connolly <span dir=3D"ltr">&lt;<a href=3D"mailto:stephen.alan.connolly@gm=
ail.com">stephen.alan.connolly@gmail.com</a>&gt;</span> wrote:<br><blockquo=
te class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc so=
lid;padding-left:1ex;">
<p>if your startup is bootstrapping then cassandra is sometimes to heavy to=
 start with.</p>
<p>i.e. it needs to be fed ram... you&#39;re not going to seriously run it =
in less than 1gb per node... that level of ram commitment can be too much w=
hile bootstrapping.</p>
<p>if your startup has enough cash to pay for 3-5 recommended spec (see wik=
i) nodes to be up 24/7 then cassandra is a good fit...</p>
<p>a friend of mine is bootstrapping a startup and had to drop back to mysq=
l while he finds his pain points and customers... he knows he will end up j=
umping back to cassandra when he gets enough customers (or a VC) but for no=
w the running costs are too much to pay from his own pocket... note that th=
e jdbc driver and cql will make jumping back easy for him (as he still test=
s with c*... just runs at present against mysql.... nuts eh!)</p>


<p>- Stephen</p>
<p>---<br>
Sent from my Android phone, so random spelling mistakes, random nonsense wo=
rds and other nonsense are a direct result of using swype to type on the sc=
reen</p><div class=3D"HOEnZb"><div class=3D"h5">
<div class=3D"gmail_quote">On 20 Nov <a href=3D"tel:2011" value=3D"+9722011=
" target=3D"_blank">2011</a> 19:07, &quot;Dotan N.&quot; &lt;<a href=3D"mai=
lto:dipidi@gmail.com" target=3D"_blank">dipidi@gmail.com</a>&gt; wrote:<br =
type=3D"attribution">
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">
<div dir=3D"ltr">Hi all,<div>my question may be more=A0philosophical=A0than=
 related technically to=A0Cassandra, but please bear with me.</div><div><br=
></div><div>Given that a young startup may not know its product full at the=
 early stages, but that it definitely points to ~200M users,</div>


<div>would Cassandra will be the right way to go?</div><div><br></div><div>=
That is, the requirement is for a large data store, that can move with prod=
uct changes and requirements swiftly.</div><div><br></div><div>Given that i=
n Cassandra one thinks hard about the queries, and then builds a model to s=
uit it best, I was thinking of</div>


<div>this situation as problematic.</div><div><br></div><div>So here are so=
me questions:</div><div><br></div><div>- would it be wiser to start with a =
more agile data store (such as mongodb) and then progress onto Cassandra, w=
hen the product itself solidifies?</div>


<div>- given that we start with Cassandra from the get go, what is a common=
 (and quick in terms of development) way or practice to change data, change=
 schemas, as the product evolves?</div><div>- is it even smart to start wit=
h Cassandra? would only startups whose core business is big data start with=
 it from the get go?</div>


<div>- how would you do map/reduce with Cassandra? how agile is that? (for =
example, can you run map/reduce _very_ frequently?)</div><div><br></div><di=
v>Thanks!</div><div><br clear=3D"all"><div dir=3D"ltr">--<div>Dotan,=A0<a h=
ref=3D"http://twitter.com/jondot" target=3D"_blank">@jondot</a></div>


</div><br>
</div></div>
</blockquote></div>
</div></div></blockquote></div><br></div></div>

--f46d0444e939040ae504b230e844--