hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Misty Stanley-Jones (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11120) Update documentation about major compaction algorithm
Date Thu, 22 May 2014 00:43:38 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005471#comment-14005471

Misty Stanley-Jones commented on HBASE-11120:

a store can only have so many files, and that's called the blocking store file count
so you cannot flush data if you have too many files, you have to wait for a compaciton
and you cannot insert if the memstore is over some threshold
but then the compaction selection might not select a single file if none of them are "good"
so if you get there, you're stuck
that's the accounting here:
boolean mayBeStuck = (candidateFiles.size() - filesCompacting.size() + futureFiles)
    >= storeConfigInfo.getBlockingFileCount();
Jean-Daniel Cryans
10:29 am
if our files we're supposed to compact, minus the ones we're already compacting, plus 1 since
those files will end up being a new store file, is greater or equal to the blocking file count
then we force a compacting

> Update documentation about major compaction algorithm
> -----------------------------------------------------
>                 Key: HBASE-11120
>                 URL: https://issues.apache.org/jira/browse/HBASE-11120
>             Project: HBase
>          Issue Type: Bug
>          Components: Compaction, documentation
>    Affects Versions: 0.98.2
>            Reporter: Misty Stanley-Jones
>            Assignee: Misty Stanley-Jones
>         Attachments: HBASE-11120.patch
> [14:20:38]  <jdcryans>	 seems that there's http://hbase.apache.org/book.html#compaction
and http://hbase.apache.org/book.html#managed.compactions
> [14:20:56]  <jdcryans>	 the latter doesn't say much, except that you should manage
> [14:21:44]  <jdcryans>	 the former gives a good description of the _old_ selection
> [14:45:25]  <jdcryans>	 this is the new selection algo since C5 / 0.96.0: https://issues.apache.org/jira/browse/HBASE-7842

This message was sent by Atlassian JIRA

View raw message