Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BD1F2200BD3 for ; Tue, 6 Dec 2016 15:03:05 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id BB908160B1B; Tue, 6 Dec 2016 14:03:05 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 0E9C1160B0C for ; Tue, 6 Dec 2016 15:03:04 +0100 (CET) Received: (qmail 83936 invoked by uid 500); 6 Dec 2016 14:02:59 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 83917 invoked by uid 99); 6 Dec 2016 14:02:59 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 06 Dec 2016 14:02:59 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id D93D62C0086 for ; Tue, 6 Dec 2016 14:02:58 +0000 (UTC) Date: Tue, 6 Dec 2016 14:02:58 +0000 (UTC) From: "Christian Esken (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CASSANDRA-13005) Cassandra TWCS is not removing fully expired tables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 06 Dec 2016 14:03:05 -0000 [ https://issues.apache.org/jira/browse/CASSANDRA-13005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Esken updated CASSANDRA-13005: ---------------------------------------- Environment: Cassandra 3.0.9 Java HotSpot(TM) 64-Bit Server VM version 25.112-b15 (Java version 1.8.0_112-b15) Linux 3.16 was: Cassandra 3.0.9 / Casandra 3.9 Java HotSpot(TM) 64-Bit Server VM version 25.112-b15 (Java version 1.8.0_112-b15) Linux 3.16 > Cassandra TWCS is not removing fully expired tables > --------------------------------------------------- > > Key: CASSANDRA-13005 > URL: https://issues.apache.org/jira/browse/CASSANDRA-13005 > Project: Cassandra > Issue Type: Bug > Components: Compaction > Environment: Cassandra 3.0.9 > Java HotSpot(TM) 64-Bit Server VM version 25.112-b15 (Java version 1.8.0_112-b15) > Linux 3.16 > Reporter: Christian Esken > Attachments: sstablemetadata-empty-type-that-is-3GB.txt > > > We have a table where all columns are stored with TTL of maximum 4 hours. Usually TWCS compaction properly removes expired data via tombstone compaction and also removes fully expired tables. The number of SSTables is nearly constant since weeks. Good. > The problem: Suddenly TWCS does not remove old SSTables any longer. They are being recreated frequently (judging form the file creation timestamp), but the number of tables is growing. Analysis and actions take so far: > - sstablemetadata shows strange data, as if the table is completely empty. > - sstabledump throws an Exception when running it on such a SSTable > - Even triggering a manual major compaction will not remove the old SSTable's. To be more precise: They are recreated with new id and timestamp (not sure whether they are identical as I cannot inspect content due to the sstabledump crash) -- This message was sent by Atlassian JIRA (v6.3.4#6332)