cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Morton <>
Subject Re: Super CF or two CFs?
Date Tue, 18 Jan 2011 08:54:25 GMT
With regard to overwrites, and assuming you always want to get all the data for a stock ticker.
Any read on the volatile data will potentially touch many sstables, this IO is unavoidable
to read this data so we may as well read as many cols as possible at this time. Whereas if
you split the data into two cf's you would incure all the IO for the volatile data plus IO
for the non volatile, and have to make two calls. (Or use different keys and make a multiget_slice
call, the IO argument still stands)

Thanks to compaction less volatile data, say cols that are written once a day, week or month,
will be tend to accrete into fewer sstables. To that end it may make sense to schedule compactions
to run after weekly bulk operations. Also take a look at the per CF compaction thresholds.

I'd recommend trying one standard CF (with the quotes packed as suggested) to start with,
run some tests and let us know how you go. There are some small penalties to using super Cfs,
see the limitations page on the wiki.

Hope that helps.

On 18/01/2011, at 9:29 PM, Steven Mac <> wrote:

> Some of the fields are indeed written in one shot, but others (such as label and categories)
are added later, so I think the question still stands.
> Hugo.
> From:
> Date: Mon, 17 Jan 2011 18:47:28 -0600
> Subject: Re: Super CF or two CFs?
> To:
> On Mon, Jan 17, 2011 at 5:12 PM, Steven Mac <> wrote:
> I guess I was maybe trying to simplify the question too much. In reality I do not have
one volatile part, but multiple ones (say all trading data of day). Each would be a supercolumn
identified by the time slot, with the individual fields as subcolumns.
> If you're always going to write these attributes in one shot, then just serialize them
and use a simple CF, there's no need for a SCF.
> -Brandon

View raw message