Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (athena.apache.org: domain of shutyaev@gmail.com designates
 209.85.223.172 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAO5xsd3VPHaQL4ygL8M84vZeO--DKob3CD1z77SeF2dsHBhZhg@mail.gmail.com>
References: 
 <CAGBp8g_qF2V_MWLpFb7UTsYG=GMWApHoKSxUE27+s2W0Obdi-Q@mail.gmail.com>
	<CACU4Y-ihnbHeoPjit-qiHyuXE0YjgOuQ7nX4NyCrQS_5Rjdd0Q@mail.gmail.com>
	<CAGBp8g_pPV5YRDXttGzOvRhXe-dpzgArSeiU6kSWNSwhhJOx_Q@mail.gmail.com>
	<CAO5xsd0uGn2KpLvDcuT50xzeDMdrxxggrYruknXtVB=m-aA4Bg@mail.gmail.com>
	<CAO5xsd3VPHaQL4ygL8M84vZeO--DKob3CD1z77SeF2dsHBhZhg@mail.gmail.com>
Date: Mon, 3 Sep 2012 09:27:28 +0400
Message-ID: 
 <CAGBp8g96R9RkKAHNCxfatsP_1wCNqgT2_2x4czkHH3yWvMNwUw@mail.gmail.com>
Subject: Re: force gc?
From: Alexander Shutyaev <shutyaev@gmail.com>
To: user@cassandra.apache.org
Content-Type: multipart/alternative; boundary=e89a8f234e5bcc868804c8c56598

--e89a8f234e5bcc868804c8c56598
Content-Type: text/plain; charset=UTF-8

Hi Peter,

I don't compare it with PosgreSQL size, I just make some estimations.. This
table / column family stores some xml documents with average raw size of
2Mb each and total size about 5Gb. However the space cassandra occupies on
disc is 70Gb (after gc_grace was set to 0 and major compaction was run).

Maybe there is some tool to analyze it? It would be great if I could
somehow export each row of a column family into a separate file - so I
could see their count and sizes. Is there any such tool? Or maybe you have
some better thoughts...

2012/9/3 Peter Schuller <peter.schuller@infidyne.com>

> > I think that was clear from your post. I don't see a problem with your
> > process. Setting gc grace to 0 and forcing compaction should indeed
> > return you to the smallest possible on-disk size.
>
> (But may be unsafe as documented; can cause deleted data to pop back up,
> etc.)
>
> --
> / Peter Schuller (@scode, http://worldmodscode.wordpress.com)
>

--e89a8f234e5bcc868804c8c56598
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi Peter,<div><br></div><div>I don&#39;t compare it with PosgreSQL size, I =
just make some estimations.. This table / column family stores some xml doc=
uments with average raw size of 2Mb each and total size about 5Gb. However =
the space cassandra occupies on disc is 70Gb (after gc_grace was set to 0 a=
nd major compaction was run).</div>
<div><br></div><div>Maybe there is some tool to analyze it? It would be gre=
at if I could somehow export each row of a column family into a separate fi=
le - so I could see their count and sizes. Is there any such tool? Or maybe=
 you have some better thoughts...</div>
<div><br><div class=3D"gmail_quote">2012/9/3 Peter Schuller <span dir=3D"lt=
r">&lt;<a href=3D"mailto:peter.schuller@infidyne.com" target=3D"_blank">pet=
er.schuller@infidyne.com</a>&gt;</span><br><blockquote class=3D"gmail_quote=
" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class=3D"im">&gt; I think that was clear from your post. I don&#39;t s=
ee a problem with your<br>
&gt; process. Setting gc grace to 0 and forcing compaction should indeed<br=
>
&gt; return you to the smallest possible on-disk size.<br>
<br>
</div>(But may be unsafe as documented; can cause deleted data to pop back =
up, etc.)<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
--<br>
/ Peter Schuller (@scode, <a href=3D"http://worldmodscode.wordpress.com" ta=
rget=3D"_blank">http://worldmodscode.wordpress.com</a>)<br>
</div></div></blockquote></div><br></div>

--e89a8f234e5bcc868804c8c56598--