Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
MIME-Version: 1.0
In-Reply-To: <CABNXB2ButXvQBGzKc7DYu7fA=i-7kkdRY6Cnapfik4fPxTvLaQ@mail.gmail.com>
References: <CAKiMtbfKCRyFTb7geRTj9ZLd42mKO5dggn_LGWhdgoSMTBdsYw@mail.gmail.com>
 <CABNXB2ButXvQBGzKc7DYu7fA=i-7kkdRY6Cnapfik4fPxTvLaQ@mail.gmail.com>
From: Ali Akhtar <ali.rac200@gmail.com>
Date: Tue, 8 Nov 2016 15:10:56 +0500
Message-ID: <CAKiMtbfvmUoKHYKdJuKVLgUvuGD+ZJYRKXU3HvFwCLNuKkgqAg@mail.gmail.com>
Subject: Re: Improving performance where a lot of updates and deletes are required?
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=047d7b873f803d48470540c75b58
archived-at: Tue, 08 Nov 2016 10:11:02 -0000

--047d7b873f803d48470540c75b58
Content-Type: text/plain; charset=UTF-8

Yes, because there will also be a lot of inserts, and the linear
scalability that c* offers is required.

But the inserts aren't static, and the data that comes in will need to be
updated in response to user events.

Data which hasn't been touched for over a week has to be deleted.
(Sensitive data, so better to delete when its out of date rather than store
it).

Couldn't really do the weekly tables without massively complicating my
report generation, as the entire dataset needs to be queried for generating
certain reports.

So my question is really about how to get the best out of c* in this sort
of scenario.

On Tue, Nov 8, 2016 at 3:05 PM, DuyHai Doan <doanduyhai@gmail.com> wrote:

> Are you sure Cassandra is a good fit for this kind of heavy update &
> delete scenario ?
>
> Otherwise, you can always use several tables (one table/day, rotating
> through 7 days for a week) and do a truncate of the table at the end of the
> day.
>
> On Tue, Nov 8, 2016 at 11:04 AM, Ali Akhtar <ali.rac200@gmail.com> wrote:
>
>> I have a use case where a lot of updates and deletes to a table will be
>> necessary.
>>
>> The deletes will be done at a scheduled time, probably at the end of the
>> day, each day.
>>
>> Updates will be done throughout the day, as new data comes in.
>>
>> Are there any guidelines on improving cassandra's performance for this
>> use case? Any caveats to be aware of? Any tips, like running nodetool
>> repair every X days?
>>
>> Thanks.
>>
>
>

--047d7b873f803d48470540c75b58
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Yes, because there will also be a lot of inserts, and the =
linear scalability that c* offers is required.<div><br></div><div>But the i=
nserts aren&#39;t static, and the data that comes in will need to be update=
d in response to user events.</div><div><br></div><div>Data which hasn&#39;=
t been touched for over a week has to be deleted. (Sensitive data, so bette=
r to delete when its out of date rather than store it).</div><div><br></div=
><div>Couldn&#39;t really do the weekly tables without massively complicati=
ng my report generation, as the entire dataset needs to be queried for gene=
rating certain reports.=C2=A0</div><div><br></div><div>So my question is re=
ally about how to get the best out of c* in this sort of scenario.</div></d=
iv><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue, Nov 8,=
 2016 at 3:05 PM, DuyHai Doan <span dir=3D"ltr">&lt;<a href=3D"mailto:doand=
uyhai@gmail.com" target=3D"_blank">doanduyhai@gmail.com</a>&gt;</span> wrot=
e:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-l=
eft:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Are you sure Cassandr=
a is a good fit for this kind of heavy update &amp; delete scenario ?<div><=
br></div><div>Otherwise, you can always use several tables (one table/day, =
rotating through 7 days for a week) and do a truncate of the table at the e=
nd of the day.</div></div><div class=3D"HOEnZb"><div class=3D"h5"><div clas=
s=3D"gmail_extra"><br><div class=3D"gmail_quote">On Tue, Nov 8, 2016 at 11:=
04 AM, Ali Akhtar <span dir=3D"ltr">&lt;<a href=3D"mailto:ali.rac200@gmail.=
com" target=3D"_blank">ali.rac200@gmail.com</a>&gt;</span> wrote:<br><block=
quote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc=
 solid;padding-left:1ex"><div dir=3D"ltr">I have a use case where a lot of =
updates and deletes to a table will be necessary.<div><br></div><div>The de=
letes will be done at a scheduled time, probably at the end of the day, eac=
h day.</div><div><br></div><div>Updates will be done throughout the day, as=
 new data comes in.<br><div><br></div><div>Are there any guidelines on impr=
oving cassandra&#39;s performance for this use case? Any caveats to be awar=
e of? Any tips, like running nodetool repair every X days?</div></div><div>=
<br></div><div>Thanks.</div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>

--047d7b873f803d48470540c75b58--