cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuki Morishita (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-4237) Add back 0.8-style memtable_lifetime feature
Date Mon, 10 Sep 2012 20:40:09 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13452425#comment-13452425
] 

Yuki Morishita commented on CASSANDRA-4237:
-------------------------------------------

bq. Hmm, I think this means that if perform a scheduled forceFlush but it's clean, we don't
schedule another flush attempt.

There is expire check when flushed memtable is clean and reschedule another flush.

bq. Maybe brute force every 10s isn't so bad?

10sec brute force would work if memtable_flush_period is set longer (seconds or minutes).


bq. Bonus: accomodates changing the period via mbean for free (which we should allow), without
having to try to retrieve a ScheduledTask and cancel it

Here, you mean the period of brute force flush?
                
> Add back 0.8-style memtable_lifetime feature
> --------------------------------------------
>
>                 Key: CASSANDRA-4237
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-4237
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Core
>    Affects Versions: 1.0.0
>            Reporter: Jonathan Ellis
>            Assignee: Yuki Morishita
>            Priority: Minor
>             Fix For: 1.2.0
>
>         Attachments: 4237.txt
>
>
> Back in 0.8 we had a memtable_lifetime_in_minutes setting.  We got rid of it in 1.0 when
we added CASSANDRA-2427, which is a better way to  ensure flushing on low-activity memtables.
> However, at the same time we also added the ability to disable durable writes.  So it's
entirely possible to configure a low-activity memtable, that isn't part of the commitlog.
 So, we should add back a memtable lifetime setting.
> An additional motive is pointed out by http://www.fsl.cs.sunysb.edu/~pshetty/socc11-gtssl.pdf:
if you have a *high* activity columnfamily, and don't require absolute durability, the commitlog
is redundant if you are flushing faster than the commitlog sync period.  So, disabling durable
writes but setting memtable lifetime to the same as the commitlog sync would be a reasonable
optimization.
> Thus, when we add back memtable lifetime, I think we should measure it in seconds or
possibly even milliseconds (to match commitlog_sync_period) rather than minutes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message