hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jeongmin kim (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-13474) stripe compaction selection is not working well when includeL0==true
Date Wed, 15 Apr 2015 06:20:58 GMT
jeongmin kim created HBASE-13474:
------------------------------------

             Summary: stripe compaction selection is not working well when includeL0==true
                 Key: HBASE-13474
                 URL: https://issues.apache.org/jira/browse/HBASE-13474
             Project: HBase
          Issue Type: Bug
          Components: Compaction
    Affects Versions: 0.98.12, 1.0.1
            Reporter: jeongmin kim


during selecting Hfiles for the Stripe Compaction,
If includeL0==true, int minFiles set to the number of allFiles in the stripe.
It make compaction for All of files in the stripe 
or No compaction at all (which is the problem). 

the Stripe compaction uses exploring compaction inside.
some of HFiles in the stripe is too big, these all files are gonna never pass the ratio check
and compaction (even minor compactions) will be cancelled almost forever.
Flushing makes more small HFiles and no compaction happening,
so numerous tiny HFiles are gonna file up in the stripe, and it’s going to be a problem.

there is no such thing as major compaction in the stripe compaction.
But we need to compact every file of the stripe to drop deletes at some point.

IMHO  there is not one stripe in the region, there are many.
when includeL0==true, compact all HFiles in the stripe without selecting is reasonable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message