Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4873B9B30 for ; Thu, 10 Nov 2011 06:58:18 +0000 (UTC) Received: (qmail 63151 invoked by uid 500); 10 Nov 2011 06:58:18 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 62484 invoked by uid 500); 10 Nov 2011 06:58:17 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 62459 invoked by uid 99); 10 Nov 2011 06:58:17 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Nov 2011 06:58:17 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Nov 2011 06:58:14 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id BD42A4579A for ; Thu, 10 Nov 2011 06:57:53 +0000 (UTC) Date: Thu, 10 Nov 2011 06:57:53 +0000 (UTC) From: "Phabricator (Commented) (JIRA)" To: issues@hbase.apache.org Message-ID: <1922468038.16695.1320908273776.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1087725354.5139.1300843085730.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-3690) Option to Exclude Bulk Import Files from Minor Compaction MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147524#comment-13147524 ] Phabricator commented on HBASE-3690: ------------------------------------ dhruba has commented on the revision "[jira] [HBASE-3690] Option to Exclude Bulk Import Files from Minor Compaction". +1, code looks good to me. REVISION DETAIL https://reviews.facebook.net/D357 > Option to Exclude Bulk Import Files from Minor Compaction > --------------------------------------------------------- > > Key: HBASE-3690 > URL: https://issues.apache.org/jira/browse/HBASE-3690 > Project: HBase > Issue Type: Bug > Components: regionserver > Reporter: Nicolas Spiegelberg > Assignee: Nicolas Spiegelberg > Priority: Minor > Attachments: D357.1.patch, HBASE-3690.patch > > > We ran an incremental scrape with HFileOutputFormat and encountered major compaction storms. This is caused by the bug in HBASE-3404. The permanent fix is a little tricky without HBASE-2856. We realized that a quicker solution for avoiding these compaction storms is to simply exclude bulk import files from minor compactions and let them only be handled by time-based major compactions. Add with functionality along with a config option to enable it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira