cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Henrik Schröder <skro...@gmail.com>
Subject Re: Question regarding major compaction.
Date Wed, 02 May 2012 19:24:05 GMT
On Tue, May 1, 2012 at 9:06 PM, Edward Capriolo <edlinuxguru@gmail.com>wrote:

> Also there are some tickets in JIRA to impose a max sstable size and
> some other related optimizations that I think got stuck behind levelDB
> in coolness factor. Not every use case is good for leveled so adding
> more tools and optimizations of the Size Tiered tables would be
> awesome.
>

Agree. We trieved leveled compaction, but that didn't work well for our
dataset and traffic. But something inbetween would probably be a nice fit
for us, a compaction model where you specify a max SSTable size, and then
your data would be split across (total size)/(max size) files. And extra
bonus points for applying generational thinking to it so that your oldest
data goes in the first file, next oldest in the next file and so on. That
way you'll have a nice separation of "dead" data and "active" data. Of
course I don't know if this is a better model than the current one, I'm
just guessing here. :-)


/Henrik

Mime
View raw message