Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Message-ID: <1966797.26201291848961635.JavaMail.jira@thor>
Date: Wed, 8 Dec 2010 17:56:01 -0500 (EST)
From: "Jonathan Gray (JIRA)" <jira@apache.org>
To: issues@hbase.apache.org
Subject: [jira] Commented: (HBASE-3320) Compaction parameter minCompactSize
 should be configurable
In-Reply-To: <13405078.23061291840022145.JavaMail.jira@thor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/HBASE-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12969542#action_12969542 ] 

Jonathan Gray commented on HBASE-3320:
--------------------------------------

size, yes.  this patch just brings in configurable parameter that's already committed in latest nicolas compaction changes on trunk.

> Compaction parameter minCompactSize should be configurable
> ----------------------------------------------------------
>
>                 Key: HBASE-3320
>                 URL: https://issues.apache.org/jira/browse/HBASE-3320
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.90.0, 0.92.0
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.90.0, 0.92.0
>
>         Attachments: HBASE-3320-v1.patch, HBASE-3320-v2.patch
>
>
> In the new compaction algorithm, there is a minCompactSize parameter which is used to include files in selection if they are under this size.
> Currently this is:
> {noformat}
>     this.minCompactSize = this.region.memstoreFlushSize * 3 / 2; // +50% pad
> {noformat}
> In a cluster, we had high setting of flush size but were doing frequent small flushes because of HLog eviction.  This led to pathological cases in compaction file selection that this algorithm is trying to avoid in the first place.
> Should make this configurable but the existing value should be fine for default in most applications.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.