cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vincent Mallet (JIRA)" <>
Subject [jira] [Commented] (CASSANDRA-6756) Provide option to avoid loading orphan SSTables on startup
Date Mon, 03 Mar 2014 17:51:22 GMT


Vincent Mallet commented on CASSANDRA-6756:

+1 on the lost+found idea.
Btw we're trying to analyze the source of some of these SSTables we're finding in some clusters
and there seems to be other causes than failed repairs (in 1.1) (OOM, problem with compaction,
etc; still investigating). Having that option would make us sleep better at night.

> Provide option to avoid loading orphan SSTables on startup
> ----------------------------------------------------------
>                 Key: CASSANDRA-6756
>                 URL:
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Vincent Mallet
>             Fix For: 1.2.16
> When Cassandra starts up, it enumerates all SSTables on disk for a known column family
and proceeds to loading all of them, even those that were left behind before the restart because
of a problem of some sort. This can lead to "data gain" (resurrected data) which is just as
bad as data loss.
> The ask is to provide a yaml config option which would allow one to turn that behavior
off by default so a cassandra cluster would be immune to data gain when nodes get restarted
(at least with Leveled where Cassandra keeps track of SSTables).
> This is sort of a follow-up to CASSANDRA-6503 (fixed in 1.2.14). We're just extremely
nervous that orphan SSTables could appear because of some other potential problem somewhere
else and cause zombie data on a random reboot. 

This message was sent by Atlassian JIRA

View raw message