incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Franc Carter <franc.car...@sirca.org.au>
Subject Re: Large number of files for Leveled Compaction
Date Mon, 17 Jun 2013 04:33:07 GMT
On Fri, Jun 7, 2013 at 2:44 PM, Franc Carter <franc.carter@sirca.org.au>wrote:

>
> Hi,
>
> We are trialling Cassandra-1.2(.4) with Leveled compaction as it looks
> like it may be a win for us.
>
> The first step of testing was to push a fairly large slab of data into the
> Column Family - we did this much faster (> x100) than we would in a
> production environment. This has left the Column Family with about 140,000
> files in the Column Family directory which seems way too high. On two of
> the nodes the CompactionStats show 2 outstanding tasks and on a third node
> there are over 13,000 outstanding tasks. However from looking at the log
> activity it looks like compaction has finished on all nodes.
>
> Is this number of files expected/normal ?
>

An addendum to this.

None of the files are *Data.db bigger than 5MB (including on the nodes that
have finished compaction). I'm wondering if I have misunderstood Leveled
Compaction, I thought that there should be data files of 50MB and 500MB
(the dataset is 190GB)

cheers


>
> cheers
>
> --
>
> *Franc Carter* | Systems architect | Sirca Ltd
>  <marc.zianideferranti@sirca.org.au>
>
> franc.carter@sirca.org.au | www.sirca.org.au
>
> Tel: +61 2 8355 2514
>
> Level 4, 55 Harrington St, The Rocks NSW 2000
>
> PO Box H58, Australia Square, Sydney NSW 1215
>
>
>


-- 

*Franc Carter* | Systems architect | Sirca Ltd
 <marc.zianideferranti@sirca.org.au>

franc.carter@sirca.org.au | www.sirca.org.au

Tel: +61 2 8355 2514

Level 4, 55 Harrington St, The Rocks NSW 2000

PO Box H58, Australia Square, Sydney NSW 1215

Mime
View raw message