Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: domain of tivv00@gmail.com designates
 209.85.213.172 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEAJz-pw6kkvjX6chO25_jkUFQ12BhkvCjzkzLkUV2j_LGinOQ@mail.gmail.com>
References: 
 <CAEAJz-pw6kkvjX6chO25_jkUFQ12BhkvCjzkzLkUV2j_LGinOQ@mail.gmail.com>
Date: Tue, 24 Apr 2012 08:37:42 +0300
Message-ID: 
 <CABWW-d38yQTyMr8SQ24PrCcar6Royq42LM=V-JEFfh89x2tqqA@mail.gmail.com>
Subject: Re: Cassandra dying when gets many deletes
From: =?KOI8-U?B?96bUwcymyiD0yc3eydvJzg==?= <tivv00@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=20cf305e28714e87a804be66276b

--20cf305e28714e87a804be66276b
Content-Type: text/plain; charset=ISO-8859-1

See https://issues.apache.org/jira/browse/CASSANDRA-3741
I did post a fix there that helped me.

2012/4/24 crypto five <cryptofive@gmail.com>

> Hi,
>
> I have 50 millions of rows in column family on 4G RAM box. I allocatedf
> 2GB to cassandra.
> I have program which is traversing this CF and cleaning some data there,
> it generates about 20k delete statements per second.
> After about of 3 millions deletions cassandra stops responding to queries:
> it doesn't react to CLI, nodetool etc.
> I see in the logs that it tries to free some memory but can't even if I
> wait whole day.
> Also I see following in  the logs:
>
> INFO [ScheduledTasks:1] 2012-04-23 18:38:13,333 StorageService.java (line
> 2647) Unable to reduce heap usage since there are no dirty column families
>
> When I am looking at memory dump I see that memory goes to
> ConcurrentSkipListMap(10%), HeapByteBuffer(13%), DecoratedKey(6%),
> int[](6%), BigInteger(8.2%), ConcurrentSkipListMap$HeadIndex(7.2%),
> ColumnFamily(6.5%), ThreadSafeSortedColumns(13.7%), long[](5.9%).
>
> What can I do to make cassandra stop dying?
> Why it can't free the memory?
> Any ideas?
>
> Thank you.
>


-- 
Best regards,
 Vitalii Tymchyshyn

--20cf305e28714e87a804be66276b
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div class=3D"gmail_extra">See=A0<a href=3D"https://issues.apache.org/jira/=
browse/CASSANDRA-3741">https://issues.apache.org/jira/browse/CASSANDRA-3741=
</a></div><div class=3D"gmail_extra">I did post a fix there that helped me.=
<br><br>
<div class=3D"gmail_quote">2012/4/24 crypto five <span dir=3D"ltr">&lt;<a h=
ref=3D"mailto:cryptofive@gmail.com" target=3D"_blank">cryptofive@gmail.com<=
/a>&gt;</span><br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .=
8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi,<div><br></div><div>I have 50 millions of rows in column family on 4G RA=
M box. I allocatedf 2GB to cassandra.</div><div>I have program which is tra=
versing this CF and cleaning some data there, it generates about 20k delete=
 statements per second.</div>

<div>After about of 3 millions deletions cassandra stops responding to quer=
ies: it doesn&#39;t react to CLI, nodetool etc.</div><div>I see in the logs=
 that it tries to free some memory but can&#39;t even if I wait whole day.=
=A0</div>

<div>Also I see following in =A0the logs:</div><div><br></div><div>INFO [Sc=
heduledTasks:1] 2012-04-23 18:38:13,333 StorageService.java (line 2647) Una=
ble to reduce heap usage since there are no dirty column families</div><div=
>

<br></div><div>When I am looking at memory dump I see that memory goes to C=
oncurrentSkipListMap(10%), HeapByteBuffer(13%), DecoratedKey(6%), int[](6%)=
, BigInteger(8.2%), ConcurrentSkipListMap$HeadIndex(7.2%), ColumnFamily(6.5=
%), ThreadSafeSortedColumns(13.7%), long[](5.9%).</div>

<div><br></div><div>What can I do to make cassandra stop dying?=A0</div><di=
v>Why it can&#39;t free the memory?</div><div>Any ideas?</div><div><br></di=
v><div>Thank you.</div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Best regards=
,<br>=A0Vitalii Tymchyshyn<br>
</div>

--20cf305e28714e87a804be66276b--