Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1F9D017271 for ; Sat, 11 Apr 2015 01:33:15 +0000 (UTC) Received: (qmail 45039 invoked by uid 500); 11 Apr 2015 01:33:14 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 44918 invoked by uid 500); 11 Apr 2015 01:33:14 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 44753 invoked by uid 99); 11 Apr 2015 01:33:14 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 11 Apr 2015 01:33:14 +0000 Date: Sat, 11 Apr 2015 01:33:14 +0000 (UTC) From: "Andrew Purtell (JIRA)" To: dev@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Resolved] (HBASE-5161) Compaction algorithm should prioritize reference files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HBASE-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-5161. ----------------------------------- Resolution: Incomplete Fix Version/s: (was: 0.92.1) > Compaction algorithm should prioritize reference files > ------------------------------------------------------ > > Key: HBASE-5161 > URL: https://issues.apache.org/jira/browse/HBASE-5161 > Project: HBase > Issue Type: Bug > Affects Versions: 0.92.0 > Reporter: Jean-Daniel Cryans > Priority: Critical > > I got myself into a state where my table was un-splittable as long as the insert load was coming in. Emergency flushes because of the low memory barrier don't check the number of store files so it never blocks, to a point where I had in one case 45 store files and the compactions were almost never done on the reference files (had 15 of them, went down by one in 20 minutes). Since you can't split regions with reference files, that region couldn't split and was doomed to just get more store files until the load stopped. > Marking this as a minor issue, what we really need is a better pushback mechanism but not prioritizing reference files seems wrong. -- This message was sent by Atlassian JIRA (v6.3.4#6332)