cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Coli (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-9577) Cassandra not performing GC on stale SStables after compaction
Date Mon, 06 Jul 2015 23:18:05 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615861#comment-14615861
] 

Robert Coli commented on CASSANDRA-9577:
----------------------------------------

A user on the cassandra-user@ mailing list ("Compaction issues, 2.0.12" thread title) reports
that they had these files, Cassandra knew they were not live before he restarted his daemon,
but when he did, they were marked live again.

Mentioning here for completeness because that version of this bug, where dead SSTables get
marked live, is very bad for consistency.

> Cassandra not performing GC on stale SStables after compaction
> --------------------------------------------------------------
>
>                 Key: CASSANDRA-9577
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-9577
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: 2.0.12.200 / DSE 4.6.1.
>            Reporter: Jeff Ferland
>            Assignee: Marcus Eriksson
>
> 		Space used (live), bytes:   878681716067
> 		Space used (total), bytes: 2227857083852
> jbf@ip-10-0-2-98:/ebs/cassandra/data/trends/trends$ sudo lsof *-Data.db 
> COMMAND  PID      USER   FD   TYPE DEVICE     SIZE/OFF  NODE NAME
> java    4473 cassandra  446r   REG   0,26  17582559172 39241 trends-trends-jb-144864-Data.db
> java    4473 cassandra  448r   REG   0,26     62040962 37431 trends-trends-jb-144731-Data.db
> java    4473 cassandra  449r   REG   0,26 829935047545 21150 trends-trends-jb-143581-Data.db
> java    4473 cassandra  452r   REG   0,26      8980406 39503 trends-trends-jb-144882-Data.db
> java    4473 cassandra  454r   REG   0,26      8980406 39503 trends-trends-jb-144882-Data.db
> java    4473 cassandra  462r   REG   0,26      9487703 39542 trends-trends-jb-144883-Data.db
> java    4473 cassandra  463r   REG   0,26     36158226 39629 trends-trends-jb-144889-Data.db
> java    4473 cassandra  468r   REG   0,26    105693505 39447 trends-trends-jb-144881-Data.db
> java    4473 cassandra  530r   REG   0,26  17582559172 39241 trends-trends-jb-144864-Data.db
> java    4473 cassandra  535r   REG   0,26    105693505 39447 trends-trends-jb-144881-Data.db
> java    4473 cassandra  542r   REG   0,26      9487703 39542 trends-trends-jb-144883-Data.db
> java    4473 cassandra  553u   REG   0,26   6431729821 39556 trends-trends-tmp-jb-144884-Data.db
> jbf@ip-10-0-2-98:/ebs/cassandra/data/trends/trends$ ls *-Data.db
> trends-trends-jb-142631-Data.db  trends-trends-jb-143562-Data.db  trends-trends-jb-143581-Data.db
 trends-trends-jb-144731-Data.db  trends-trends-jb-144883-Data.db
> trends-trends-jb-142633-Data.db  trends-trends-jb-143563-Data.db  trends-trends-jb-144530-Data.db
 trends-trends-jb-144864-Data.db  trends-trends-jb-144889-Data.db
> trends-trends-jb-143026-Data.db  trends-trends-jb-143564-Data.db  trends-trends-jb-144551-Data.db
 trends-trends-jb-144881-Data.db  trends-trends-tmp-jb-144884-Data.db
> trends-trends-jb-143533-Data.db  trends-trends-jb-143578-Data.db  trends-trends-jb-144552-Data.db
 trends-trends-jb-144882-Data.db
> jbf@ip-10-0-2-98:/ebs/cassandra/data/trends/trends$ cd -
> /mnt/cassandra/data/trends/trends
> jbf@ip-10-0-2-98:/mnt/cassandra/data/trends/trends$ sudo lsof * 
> jbf@ip-10-0-2-98:/mnt/cassandra/data/trends/trends$ ls *-Data.db
> trends-trends-jb-124502-Data.db  trends-trends-jb-141113-Data.db  trends-trends-jb-141377-Data.db
 trends-trends-jb-141846-Data.db  trends-trends-jb-144890-Data.db
> trends-trends-jb-125457-Data.db  trends-trends-jb-141123-Data.db  trends-trends-jb-141391-Data.db
 trends-trends-jb-141871-Data.db  trends-trends-jb-41121-Data.db
> trends-trends-jb-130016-Data.db  trends-trends-jb-141137-Data.db  trends-trends-jb-141538-Data.db
 trends-trends-jb-141883-Data.db  trends-trends.trends_date_idx-jb-2100-Data.db
> trends-trends-jb-139563-Data.db  trends-trends-jb-141358-Data.db  trends-trends-jb-141806-Data.db
 trends-trends-jb-142033-Data.db
> trends-trends-jb-141102-Data.db  trends-trends-jb-141363-Data.db  trends-trends-jb-141829-Data.db
 trends-trends-jb-144553-Data.db
> Compaction started  INFO [CompactionExecutor:6661] 2015-06-05 14:02:36,515 CompactionTask.java
(line 120) Compacting [SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-124502-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141358-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141883-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141846-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141871-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141391-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-139563-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-125457-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141806-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141102-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141123-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-41121-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141137-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141113-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-142033-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141829-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141377-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141538-Data.db'), SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-141363-Data.db'),
SSTableReader(path='/mnt/cassandra/data/trends/trends/trends-trends-jb-130016-Data.db')]
> Compaction ended:  INFO [CompactionExecutor:6661] 2015-06-09 06:54:27,527 CompactionTask.java
(line 296) Compacted 20 sstables to [/ebs/cassandra/data/trends/trends/trends-trends-jb-143581,].
 1,260,539,306,144 bytes to 829,935,047,545 (~65% of original) in 319,910,989ms = 2.474087MB/s.
 1,913,263,636 total partitions merged to 873,858,309.  Partition merge counts were {1:391213541,
2:241603436, 3:102139024, 4:52438965, 5:47749892, 6:13962210, 7:9923980, 8:8363815, 9:3626260,
10:1413014, 11:615314, 12:336503, 13:416749, 14:55606, }
> date: Wed Jun 10 23:43:31 UTC 2015



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message