Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 2D82A200B4B for ; Thu, 21 Jul 2016 10:40:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 2C22C160A72; Thu, 21 Jul 2016 08:40:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 76F18160A68 for ; Thu, 21 Jul 2016 10:40:21 +0200 (CEST) Received: (qmail 13483 invoked by uid 500); 21 Jul 2016 08:40:20 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 13469 invoked by uid 99); 21 Jul 2016 08:40:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 21 Jul 2016 08:40:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 7D8AD2C0D57 for ; Thu, 21 Jul 2016 08:40:20 +0000 (UTC) Date: Thu, 21 Jul 2016 08:40:20 +0000 (UTC) From: "Wei Deng (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CASSANDRA-6958) upgradesstables does not maintain levels for existing SSTables MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 21 Jul 2016 08:40:22 -0000 [ https://issues.apache.org/jira/browse/CASSANDRA-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Deng updated CASSANDRA-6958: -------------------------------- Labels: lcs (was: ) > upgradesstables does not maintain levels for existing SSTables > -------------------------------------------------------------- > > Key: CASSANDRA-6958 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6958 > Project: Cassandra > Issue Type: Bug > Reporter: Wei Deng > Assignee: Marcus Eriksson > Labels: lcs > Fix For: 2.0.7 > > Attachments: 0001-Use-6958-v2.patch, 0001-Use-LeveledCompactionTask-for-upgradesstables-when-L.patch > > > Initially ran into this issue on a DSE 3.2 (C* 1.2) to DSE 4.0 (C* 2.0) upgrade, and then I was able to reproduce it when testing an upgrade from C* 2.0.5 to C* 2.1-beta so the problem still exists in the latest code. > Basically after you've upgraded to the new version and run "nodetool upgradesstables" on a CF/table that has been using LCS, then all of the non-L0 SSTables will be changed to L0 in the upgraded SSTables. In other words, they don't maintain their level and will have to go through the compaction again. The problem is that if you've got thousands of non-L0 SSTables before the upgrade, then all of these files showing up in L0 will push the system to do STCS and start to build some huge L0 tables. If a user doesn't budget enough free space (for example, if they used the recommended guideline and only budgeted 10% of free space because LCS is in use), then this STCS in L0 effect will have them run out of space. -- This message was sent by Atlassian JIRA (v6.3.4#6332)