Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@cassandra.apache.org
Date: Thu, 4 Aug 2016 16:44:20 +0000 (UTC)
From: "Marcus Eriksson (JIRA)" <jira@apache.org>
To: commits@cassandra.apache.org
Message-ID: <JIRA.12910075.1446572807000.226200.1470329060618@Atlassian.JIRA>
In-Reply-To: <JIRA.12910075.1446572807000@Atlassian.JIRA>
References: <JIRA.12910075.1446572807000@Atlassian.JIRA> <JIRA.12910075.1446572807035@arcas>
Subject: [jira] [Commented] (CASSANDRA-10643) Implement compaction for a
 specific token range
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 04 Aug 2016 16:44:22 -0000


    [ https://issues.apache.org/jira/browse/CASSANDRA-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408089#comment-15408089 ] 

Marcus Eriksson commented on CASSANDRA-10643:
---------------------------------------------

[~vkasar] the test does not cancel any ongoing compactions - we need to cancel the compactions before picking the sstable instances (when cancelling the compaction we reset the original instances which have not had their starts moved or have been early opened), otherwise we can't mark them as compacting.

I'll get it committed tomorrow, thanks!

> Implement compaction for a specific token range
> -----------------------------------------------
>
>                 Key: CASSANDRA-10643
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10643
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Compaction
>            Reporter: Vishy Kasar
>            Assignee: Vishy Kasar
>              Labels: lcs
>         Attachments: 10643-trunk-REV01.txt, 10643-trunk-REV02.txt, 10643-trunk-REV03.txt
>
>
> We see repeated cases in production (using LCS) where small number of users generate a large number repeated updates or tombstones. Reading data of such users brings in large amounts of data in to java process. Apart from the read itself being slow for the user, the excessive GC affects other users as well. 
> Our solution so far is to move from LCS to SCS and back. This takes long and is an over kill if the number of outliers is small. For such cases, we can implement the point compaction of a token range. We make the nodetool compact take a starting and ending token range and compact all the SSTables that fall with in that range. We can refuse to compact if the number of sstables is beyond a max_limit.
> Example: 
> nodetool -st 3948291562518219268 -et 3948291562518219269 compact keyspace table


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)