hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8299) ExploringCompactionPolicy can get stuck in rare cases.
Date Tue, 23 Apr 2013 17:55:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13639312#comment-13639312
] 

Jean-Daniel Cryans commented on HBASE-8299:
-------------------------------------------

One important thing that was changed in the latest patch that you haven't mentioned Elliott
is that getMinCompactSize() is now compared against the whole selection's size. This is important
because before that, any small files could easily trigger major compactions. I've been running
with a patched 0.94 over the weekend while inserting tiny bulk loaded files every ~10 minutes
and the only times it major compacted was when the sum of all the bulk loaded files was within
ratio of the main big file. I'm really happy about this patch.

+1 for commit once the patch is cleaned up.
                
> ExploringCompactionPolicy can get stuck in rare cases.
> ------------------------------------------------------
>
>                 Key: HBASE-8299
>                 URL: https://issues.apache.org/jira/browse/HBASE-8299
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.95.1
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>         Attachments: HBASE-8299-0.patch, HBASE-8299-1.patch, HBASE-8299-2.patch
>
>
> If the files are very oddly sized then it's possible that ExploringCompactionPolicy can
get stuck.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message