Return-Path: Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: (qmail 88114 invoked from network); 5 Oct 2010 21:05:01 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 5 Oct 2010 21:05:01 -0000 Received: (qmail 69477 invoked by uid 500); 5 Oct 2010 21:05:01 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 69446 invoked by uid 500); 5 Oct 2010 21:05:01 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 69438 invoked by uid 99); 5 Oct 2010 21:05:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Oct 2010 21:05:01 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 05 Oct 2010 21:04:59 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o95L4btt025216 for ; Tue, 5 Oct 2010 21:04:37 GMT Message-ID: <24300988.556611286312677916.JavaMail.jira@thor> Date: Tue, 5 Oct 2010 17:04:37 -0400 (EDT) From: "Jonathan Gray (JIRA)" To: issues@hbase.apache.org Subject: [jira] Assigned: (HBASE-3083) Major compaction check should use new timestamp meta information in HFiles (rather than dfs timestamp) along with TTL to allow major even if single file In-Reply-To: <22020932.556571286312677277.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Gray reassigned HBASE-3083: ------------------------------------ Assignee: Prakash Khemani Assigning to Prakash for now. I will work with him on this. Plan is to get this done this week. > Major compaction check should use new timestamp meta information in HFiles (rather than dfs timestamp) along with TTL to allow major even if single file > -------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: HBASE-3083 > URL: https://issues.apache.org/jira/browse/HBASE-3083 > Project: HBase > Issue Type: Improvement > Reporter: Jonathan Gray > Assignee: Prakash Khemani > Fix For: 0.90.0 > > > Periodic major compactions have a separate set of checks prior to submitting the compaction request. > Currently, if there is a single file, and it is the result of a major compaction, then it is skipped. However, there is a check that will still allow it if the timestamp of the file is older than the TTL of that Store. > This is not ideal because the timestamp of the file is the latest timestamp in the file rather than the oldest. Meta information was introduced to HFiles that stores the max/min timestamp of KVs in the file. We should use the min timestamp from that meta info rather than the file stamp itself. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.