cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vijay (Commented) (JIRA)" <>
Subject [jira] [Commented] (CASSANDRA-3635) Throttle validation separately from other compaction
Date Thu, 15 Dec 2011 19:06:31 GMT


Vijay commented on CASSANDRA-3635:

I think it will be much better if we can prioritize, long running compaction vs normal compaction,
lets sat we have 

10MB Compaction limit
2MB Validation compaction limit

2MB is the limit for the validation for a while and when normal compaction kicks in we might
want to hold the validation and do the compction complete because that will affect the read
performance and continue with the validation compaction after that. by doing this we can set
something like 

12MB Compaction limit
6 MB Validation compaction limit

and still be within the HDD limit of 12MB.
The good thing about normal compaction is that it is spread out and not all the nodes are
not involved in it.

I am starting to think that we can do repairs one by one for a range (within a region), so
the traffic doesnt get stuck waiting for the IO. Hope it makes sense.
> Throttle validation separately from other compaction
> ----------------------------------------------------
>                 Key: CASSANDRA-3635
>                 URL:
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Sylvain Lebresne
>            Assignee: Sylvain Lebresne
>            Priority: Minor
>              Labels: repair
>             Fix For: 0.8.10, 1.0.7
>         Attachments: 0001-separate-validation-throttling.patch
> Validation compaction is fairly ressource intensive. It is possible to throttle it with
other compaction, but there is cases where you really want to throttle it rather aggressively
but don't necessarily want to have minor compactions throttled that much. The goal is to (optionally)
allow to set a separate throttling value for validation.
> PS: I'm not pretending this will solve every repair problem or anything. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message