Return-Path: Delivered-To: apmail-hadoop-hbase-dev-archive@minotaur.apache.org Received: (qmail 21126 invoked from network); 16 Apr 2010 01:13:49 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Apr 2010 01:13:49 -0000 Received: (qmail 31127 invoked by uid 500); 16 Apr 2010 01:13:49 -0000 Delivered-To: apmail-hadoop-hbase-dev-archive@hadoop.apache.org Received: (qmail 31101 invoked by uid 500); 16 Apr 2010 01:13:49 -0000 Mailing-List: contact hbase-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hbase-dev@hadoop.apache.org Delivered-To: mailing list hbase-dev@hadoop.apache.org Received: (qmail 31093 invoked by uid 99); 16 Apr 2010 01:13:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Apr 2010 01:13:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Apr 2010 01:13:46 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o3G1DPHl000792 for ; Thu, 15 Apr 2010 21:13:25 -0400 (EDT) Message-ID: <31648592.791271380405047.JavaMail.jira@thor> Date: Thu, 15 Apr 2010 21:13:25 -0400 (EDT) From: "stack (JIRA)" To: hbase-dev@hadoop.apache.org Subject: [jira] Resolved: (HBASE-2453) Revisit compaction policies after HBASE-2248 commit In-Reply-To: <13826409.151411271366450620.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-2453. -------------------------- Hadoop Flags: [Reviewed] Assignee: Jonathan Gray Resolution: Fixed Applied to 0.20.4 and 0.20.4 and trunk. Made HBASE-2454 for major compaction delete issue. Thanks for patch Jon. > Revisit compaction policies after HBASE-2248 commit > --------------------------------------------------- > > Key: HBASE-2453 > URL: https://issues.apache.org/jira/browse/HBASE-2453 > Project: Hadoop HBase > Issue Type: Improvement > Reporter: Jonathan Gray > Assignee: Jonathan Gray > Priority: Critical > Fix For: 0.20.4, 0.20.5, 0.21.0 > > Attachments: HBASE-2453-v1.patch > > > HBASE-2248 turned Gets into Scans server-side. It also removed the invariant that deletes in a file only apply to other files and not itself (no longer processes MemStore deletes when the delete happens). This has implications for our minor compaction policy. > We are currently processing deletes during minor compactions in a way that makes it so we do the actual deleting as we compact, but we retain the delete records themselves. This makes it so we retain the invariant of deletes only applying to other files. > Since this is now gone post HBASE-2248, we should revisit our compaction policies. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira