Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Message-ID: <29095605.29041291857722085.JavaMail.jira@thor>
Date: Wed, 8 Dec 2010 20:22:02 -0500 (EST)
From: "Jonathan Gray (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Subject: [jira] Updated: (HBASE-3320) Compaction parameter minCompactSize
 should be configurable
In-Reply-To: <13405078.23061291840022145.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HBASE-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Gray updated HBASE-3320:
---------------------------------

       Resolution: Fixed
    Fix Version/s:     (was: 0.92.0)
     Hadoop Flags: [Reviewed]
           Status: Resolved  (was: Patch Available)

Committed to branch, not trunk.

> Compaction parameter minCompactSize should be configurable
> ----------------------------------------------------------
>
>                 Key: HBASE-3320
>                 URL: https://issues.apache.org/jira/browse/HBASE-3320
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.90.0, 0.92.0
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.90.0
>
>         Attachments: HBASE-3320-v1.patch, HBASE-3320-v2.patch
>
>
> In the new compaction algorithm, there is a minCompactSize parameter which is used to include files in selection if they are under this size.
> Currently this is:
> {noformat}
>     this.minCompactSize = this.region.memstoreFlushSize * 3 / 2; // +50% pad
> {noformat}
> In a cluster, we had high setting of flush size but were doing frequent small flushes because of HLog eviction.  This led to pathological cases in compaction file selection that this algorithm is trying to avoid in the first place.
> Should make this configurable but the existing value should be fine for default in most applications.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.