hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jeongmin kim (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HBASE-13474) stripe compaction selection is not working well when includeL0==true
Date Thu, 16 Apr 2015 15:12:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-13474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

jeongmin kim resolved HBASE-13474.
    Resolution: Not A Problem

> stripe compaction selection is not working well when includeL0==true
> --------------------------------------------------------------------
>                 Key: HBASE-13474
>                 URL: https://issues.apache.org/jira/browse/HBASE-13474
>             Project: HBase
>          Issue Type: Bug
>          Components: Compaction
>    Affects Versions: 1.0.1, 0.98.12
>            Reporter: jeongmin kim
>            Assignee: jeongmin kim
>         Attachments: HBASE-13474.patch
> during selecting Hfiles for the Stripe Compaction,
> If includeL0==true, int minFiles set to the number of allFiles in the stripe.
> It make compaction for All of files in the stripe 
> or No compaction at all (which is the problem). 
> the Stripe compaction uses exploring compaction inside.
> some of HFiles in the stripe is too big, these all files are gonna never pass the ratio
> and compaction will be cancelled 
> next time the compaction is occurred, includeL0 will be true again. 
> so compactions (even minor compactions) will not happen almost forever.
> Flushing makes more small HFiles and no compaction happening,
> so numerous tiny HFiles are gonna file up in the stripe, and it’s going to be a problem.
> there is no such thing as major compaction in the stripe compaction.
> But we need to compact every file of the stripe to drop deletes at some point.
> IMHO  there is not one stripe in the region, there are many.
> when includeL0==true, compact all HFiles in the stripe without selecting is reasonable.

This message was sent by Atlassian JIRA

View raw message