Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 03843962E for ; Tue, 1 May 2012 16:14:14 +0000 (UTC) Received: (qmail 97849 invoked by uid 500); 1 May 2012 16:14:13 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 97814 invoked by uid 500); 1 May 2012 16:14:13 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 97806 invoked by uid 99); 1 May 2012 16:14:13 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 May 2012 16:14:13 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 01 May 2012 16:14:11 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 8736A42A254 for ; Tue, 1 May 2012 16:13:50 +0000 (UTC) Date: Tue, 1 May 2012 16:13:50 +0000 (UTC) From: "Sam Tunnicliffe (JIRA)" To: commits@cassandra.apache.org Message-ID: <844183767.13555.1335888830555.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1331133015.13892.1333571247068.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Issue Comment Edited] (CASSANDRA-4116) check most recent TS values in SSTables when a row tombstone has already been encountered MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13265881#comment-13265881 ] Sam Tunnicliffe edited comment on CASSANDRA-4116 at 5/1/12 4:12 PM: -------------------------------------------------------------------- Updated patches as per comments. In {{collectAllData}}, collect the eligible iterators in a multimap with key = maxTimestamp (I guess that its pretty unlikely for two sstables to have the exact same timestamp, but using a Multimap doesn't really add any cost). Then, if we did find a row tombstone, only keep the iterators from younger sstables. Otherwise, keep all that we collected. was (Author: beobal): Updated patches as per comments. In {code}collectAllData{code}, collect the eligible iterators in a multimap with key = maxTimestamp (I guess that its pretty unlikely for two sstables to have the exact same timestamp, but using a Multimap doesn't really add any cost). Then, if we did find a row tombstone, only keep the iterators from younger sstables. Otherwise, keep all that we collected. > check most recent TS values in SSTables when a row tombstone has already been encountered > ----------------------------------------------------------------------------------------- > > Key: CASSANDRA-4116 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4116 > Project: Cassandra > Issue Type: Bug > Reporter: Matthew F. Dennis > Assignee: Sam Tunnicliffe > Fix For: 1.2 > > Attachments: v1-0001-CASSANDRA-4116-After-Row-tombstone-skip-earlier-SSTabl.txt, v1-0002-CASSANDRA-4116-Set-SSTable-maxTimestamp-correctly-for-.txt > > > once C* comes across a row tombstone, C* should check the TS on the tombstone against all SSTables. If the most recent TS in an SST is older than the row tombstone, that entire SST (or the remainder of it) can be safely ignored. > There are two drivers for this. > * avoid checking column values that could not possibly be in the result set > * avoid OOMing because all the tombstones are temporarily kept in memory. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira