Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <CAEDUwd3tuK_5djkPTGsFcBVEudw=Mif-JKLBmB3DdjvPwfp_OQ@mail.gmail.com>
References: <D2DE7A8F.1A11D%paagrawa@amazon.com>
 <D2DE7BC8.1A12F%paagrawa@amazon.com>
 <D2DE7C81.1A137%paagrawa@amazon.com>
 <CAEDUwd3tuK_5djkPTGsFcBVEudw=Mif-JKLBmB3DdjvPwfp_OQ@mail.gmail.com>
From: daemeon reiydelle <daemeonr@gmail.com>
Date: Tue, 9 Feb 2016 08:39:02 -0800
Message-ID: 
 <CAOUOv0EH950hsCF9AUcDUVnWAgQMg7-hF5SNHRWU4t+J7n2y5w@mail.gmail.com>
Subject: Re: Cassandra Collections performance issue
To: user@cassandra.apache.org
Cc: "Peddi, Praveen" <peddi@amazon.com>
Content-Type: multipart/alternative; boundary=001a1130d17a3ec53c052b58f6e0

--001a1130d17a3ec53c052b58f6e0
Content-Type: text/plain; charset=UTF-8

I think the key to your problem might be around "we overwrite every value".
You are creating a large number of tombstones, forcing many reads to pull
current results. You would do well to rethink why you are having to to
overwrite values all the time under the same key. You would be better to
figure out haw to add values under a key then age off the old values. I
would say that (at least at scale) you have a classic anti-pattern in play.


*.......*


*Daemeon C.M. ReiydelleUSA (+1) 415.501.0198London (+44) (0) 20 8144 9872*

On Mon, Feb 8, 2016 at 5:23 PM, Robert Coli <rcoli@eventbrite.com> wrote:

> On Mon, Feb 8, 2016 at 2:10 PM, Agrawal, Pratik <paagrawa@amazon.com>
> wrote:
>
>> Recently we added one of the table fields from as Map<text, text> in *Cassandra
>> 2.1.11*. Currently we read every field from Map and overwrite map
>> values. Map is of size 3. We saw that writes are 30-40% slower while reads
>> are 70-80% slower. Please find below some metrics that can help.
>>
>> My question is, Are there any known issues in Cassandra map performance?
>> As I understand it each of the CQL3 Map entry, maps to a column in
>> cassandra, with that assumption we are just creating 3 columns right? Any
>> insight on this issue would be helpful.
>>
>
> I have previously heard reports along similar lines, but in the other
> direction.
>
> eg - "I moved from a collection to a TEXT column with JSON in it, and my
> reads and writes both became much faster!"
>
> I'm not sure if the issue has been raised as an Apache Cassandra Jira, iow
> if it is a known and expected limitation as opposed to just a performance
> issue.
>
> If I were you, I would consider filing a repro case as a Jira ticket, and
> responding to this thread with its URL. :D
>
> =Rob
>
>

--001a1130d17a3ec53c052b58f6e0
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:comic sa=
ns ms,sans-serif;color:rgb(7,55,99)">I think the key to your problem might =
be around &quot;we overwrite every value&quot;. You are creating a large nu=
mber of tombstones, forcing many reads to pull current results. You would d=
o well to rethink why you are having to to overwrite values all the time un=
der the same key. You would be better to figure out haw to add values under=
 a key then age off the old values. I would say that (at least at scale) yo=
u have a classic anti-pattern in play.<br></div></div><div class=3D"gmail_e=
xtra"><br clear=3D"all"><div><div class=3D"gmail_signature"><div dir=3D"ltr=
"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><span style=3D"color:rgb(56,1=
18,29)"><span style=3D"background-color:rgb(255,255,255)"><b><span style=3D=
"font-family:comic sans ms,sans-serif"></span></b></span></span><span style=
=3D"color:rgb(56,118,29)"><span style=3D"background-color:rgb(255,255,255)"=
><b><span style=3D"font-family:comic sans ms,sans-serif"><br>.......</span>=
</b></span></span><span style=3D"color:rgb(56,118,29)"><span style=3D"backg=
round-color:rgb(255,255,255)"><b><span style=3D"font-family:comic sans ms,s=
ans-serif"><br><br>Daemeon C.M. Reiydelle<br>USA (+1) 415.501.0198<br>Londo=
n (+44) (0) 20 8144 9872</span></b></span></span><font size=3D"1"><i><br></=
i></font></div></div></div></div></div></div></div>
<br><div class=3D"gmail_quote">On Mon, Feb 8, 2016 at 5:23 PM, Robert Coli =
<span dir=3D"ltr">&lt;<a href=3D"mailto:rcoli@eventbrite.com" target=3D"_bl=
ank">rcoli@eventbrite.com</a>&gt;</span> wrote:<br><blockquote class=3D"gma=
il_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-lef=
t:1ex"><div dir=3D"ltr"><div class=3D"gmail_extra"><div class=3D"gmail_quot=
e"><span class=3D"">On Mon, Feb 8, 2016 at 2:10 PM, Agrawal, Pratik <span d=
ir=3D"ltr">&lt;<a href=3D"mailto:paagrawa@amazon.com" target=3D"_blank">paa=
grawa@amazon.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote"=
 style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


<div style=3D"word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-fam=
ily:Calibri,sans-serif">
<div>Recently we added one of the table fields from as Map&lt;text, text&gt=
; in <b>Cassandra 2.1.11</b>. Currently we read every field from Map and ov=
erwrite map values. Map is of size 3. We saw that writes are 30-40% slower =
while reads are 70-80% slower. Please
 find below some metrics that can help.=C2=A0<br></div><span><div><div styl=
e=3D"word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calib=
ri,sans-serif"><span><div><div style=3D"word-wrap:break-word;color:rgb(0,0,=
0);font-size:14px;font-family:Calibri,sans-serif"><span><div style=3D"word-=
wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-se=
rif"><div>
<div><br>
</div>
<div>My question is, Are there any known issues in Cassandra map performanc=
e?=C2=A0 As I understand it each of the CQL3 Map entry, maps to a column in=
 cassandra, with that assumption we are just creating 3 columns right? Any =
insight on this issue would be helpful.</div></div></div></span></div></div=
></span></div></div></span></div></blockquote><div><br></div></span><div>I =
have previously heard reports along similar lines, but in the other directi=
on.</div><div><br></div><div>eg - &quot;I moved from a collection to a TEXT=
 column with JSON in it, and my reads and writes both became much faster!&q=
uot;</div><div><br></div><div>I&#39;m not sure if the issue has been raised=
 as an Apache Cassandra Jira, iow if it is a known and expected limitation =
as opposed to just a performance issue.</div><div><br></div><div>If I were =
you, I would consider filing a repro case as a Jira ticket, and responding =
to this thread with its URL. :D</div><div><br></div><div>=3DRob</div><div>=
=C2=A0</div></div></div></div>
</blockquote></div><br></div>

--001a1130d17a3ec53c052b58f6e0--