incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From DuyHai Doan <doanduy...@gmail.com>
Subject Re: Storing log structured data in Cassandra without compactions for performance boost.
Date Wed, 07 May 2014 20:36:38 GMT
Hello Kevin

 You can disable compaction by configuring the compaction options of your
table as follow:

  compaction={'min_threshold': '0', 'class':
'SizeTieredCompactionStrategy', 'max_threshold': '0'}

Regards

 Duy Hai DOAN


On Wed, May 7, 2014 at 2:55 AM, Kevin Burton <burton@spinn3r.com> wrote:

> I'm looking at storing log data in Cassandra…
>
> Every record is a unique timestamp for the key, and then the log line for
> the value.
>
> I think it would be best to just disable compactions.
>
> - there will never be any deletes.
>
> - all the data will be accessed in time range (probably partitioned
> randomly) and sequentially.
>
> So every time a memtable flushes, we will just keep that SSTable forever.
>
> Compacting the data is kind of redundant in this situation.
>
> I was thinking the best strategy is to use setcompactionthreshold and set
> the value VERY high to compactions are never triggered.
>
> Also, It would be IDEAL to be able to tell cassandra to just drop a full
> SSTable so that I can truncate older data without having to do a major
> compaction and without having to mark everything with a tombstone.  Is this
> possible?
>
>
>
> --
>
> Founder/CEO Spinn3r.com
> Location: *San Francisco, CA*
> Skype: *burtonator*
> blog: http://burtonator.wordpress.com
> … or check out my Google+ profile<https://plus.google.com/102718274791889610666/posts>
> <http://spinn3r.com>
> War is peace. Freedom is slavery. Ignorance is strength. Corporations are
> people.
>
>

Mime
View raw message