Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: error (nike.apache.org: encountered temporary error during SPF
 processing of domain of rolo@pythian.com)
MIME-Version: 1.0
In-Reply-To: 
 <CADYwe7423QJ0=1QP04LFBtBSwedUy_HnWAw9nBJW23cv3rg0pw@mail.gmail.com>
References: 
 <CADYwe76myKmQdhrc-C56mkao1CpOiZXXVH1PoXoF6LrJGoVG6w@mail.gmail.com>
 <CADYwe7423QJ0=1QP04LFBtBSwedUy_HnWAw9nBJW23cv3rg0pw@mail.gmail.com>
From: Carlos Rolo <rolo@pythian.com>
Date: Tue, 21 Apr 2015 13:16:05 +0200
Message-ID: 
 <CALcD3PsPHSi6cAHTXZBqg8hVdbD93kfjYButq6WOZJfFAL0VXA@mail.gmail.com>
Subject: Re: LCS Strategy, compaction pending tasks keep increasing
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=001a1134bbc65df35705143a2da4

--001a1134bbc65df35705143a2da4
Content-Type: text/plain; charset=UTF-8

Are you on version 2.1.x?

Regards,

Carlos Juzarte Rolo
Cassandra Consultant

Pythian - Love your data

rolo@pythian | Twitter: cjrolo | Linkedin: *linkedin.com/in/carlosjuzarterolo
<http://linkedin.com/in/carlosjuzarterolo>*
Mobile: +31 6 159 61 814 | Tel: +1 613 565 8696 x1649
www.pythian.com

On Tue, Apr 21, 2015 at 1:06 PM, Anishek Agarwal <anishek@gmail.com> wrote:

> the "some_bits" column has about 14-15 bytes of data per key.
>
> On Tue, Apr 21, 2015 at 4:34 PM, Anishek Agarwal <anishek@gmail.com>
> wrote:
>
>> Hello,
>>
>> I am inserting about 100 million entries via datastax-java driver to a
>> cassandra cluster of 3 nodes.
>>
>> Table structure is as
>>
>> create keyspace test with replication = {'class':
>> 'NetworkTopologyStrategy', 'DC' : 3};
>>
>> CREATE TABLE test_bits(id bigint primary key , some_bits text) with
>> gc_grace_seconds=0 and compaction = {'class': 'LeveledCompactionStrategy'}
>> and compression={'sstable_compression' : ''};
>>
>> have 75 threads that are inserting data into the above table with each
>> thread having non over lapping keys.
>>
>> I see that the number of pending tasks via "nodetool compactionstats"
>> keeps increasing and looks like from "nodetool cfstats test.test_bits" has
>> SSTTable levels as [154/4, 8, 0, 0, 0, 0, 0, 0, 0],
>>
>> Why is compaction not kicking in ?
>>
>> thanks
>> anishek
>>
>
>

-- 


--


--001a1134bbc65df35705143a2da4
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Are you on version 2.1.x?<br></div><div class=3D"gmail_ext=
ra"><br clear=3D"all"><div><div class=3D"gmail_signature"><div dir=3D"ltr">=
<div><div dir=3D"ltr"><div>Regards,<br></div><div><br></div><div>Carlos Juz=
arte Rolo</div><div>Cassandra Consultant</div><div>=C2=A0</div><div>Pythian=
 - Love your data</div><div><br></div><div>rolo@pythian | Twitter: cjrolo |=
 Linkedin: <font color=3D"#1155cc"><u><a href=3D"http://linkedin.com/in/car=
losjuzarterolo" target=3D"_blank">linkedin.com/in/carlosjuzarterolo</a></u>=
</font></div><div>Mobile: +31 6 159 61 814 | Tel: +1 613 565 8696 x1649</di=
v><div><a href=3D"http://www.pythian.com/" style=3D"color:rgb(17,85,204)" t=
arget=3D"_blank">www.pythian.com</a></div></div></div></div></div></div>
<br><div class=3D"gmail_quote">On Tue, Apr 21, 2015 at 1:06 PM, Anishek Aga=
rwal <span dir=3D"ltr">&lt;<a href=3D"mailto:anishek@gmail.com" target=3D"_=
blank">anishek@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmai=
l_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left=
:1ex"><div dir=3D"ltr">the &quot;some_bits&quot; column has about 14-15 byt=
es of data per key.</div><div class=3D"gmail_extra"><br><div class=3D"gmail=
_quote">On Tue, Apr 21, 2015 at 4:34 PM, Anishek Agarwal <span dir=3D"ltr">=
&lt;<a href=3D"mailto:anishek@gmail.com" target=3D"_blank">anishek@gmail.co=
m</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margi=
n:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">=
Hello,<div><br></div><div>I am inserting about 100 million entries via data=
stax-java driver to a cassandra cluster of 3 nodes.</div><div><br></div><di=
v>Table structure is as=C2=A0</div><div><br></div><div>create keyspace test=
 with replication =3D {&#39;class&#39;: &#39;NetworkTopologyStrategy&#39;, =
&#39;DC&#39; : 3};<br></div><div><br></div><div>CREATE TABLE test_bits(id b=
igint primary key , some_bits text) with gc_grace_seconds=3D0 and compactio=
n =3D {&#39;class&#39;: &#39;LeveledCompactionStrategy&#39;} and compressio=
n=3D{&#39;sstable_compression&#39; : &#39;&#39;};<br></div><div><br></div><=
div>have 75 threads that are inserting data into the above table with each =
thread having non over lapping keys.=C2=A0</div><div><br></div><div>I see t=
hat the number of pending tasks via &quot;nodetool compactionstats&quot; ke=
eps increasing and looks like from &quot;nodetool cfstats test.test_bits&qu=
ot; has SSTTable levels as [154/4, 8, 0, 0, 0, 0, 0, 0, 0],</div><div><br><=
/div><div>Why is compaction not kicking in ?</div><div><br></div><div>thank=
s</div><span><font color=3D"#888888"><div>anishek</div></font></span></div>
</blockquote></div><br></div>
</blockquote></div><br></div>

<br>
<p>--</p><p><br><br></p><p></p>
--001a1134bbc65df35705143a2da4--