hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-5369) Compaction selection based on the hotness of the HFile's block in the block cache
Date Fri, 08 Aug 2014 18:35:12 GMT

     [ https://issues.apache.org/jira/browse/HBASE-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

stack updated HBASE-5369:
-------------------------

    Component/s: Compaction
                 BlockCache

> Compaction selection based on the hotness of the HFile's block in the block cache
> ---------------------------------------------------------------------------------
>
>                 Key: HBASE-5369
>                 URL: https://issues.apache.org/jira/browse/HBASE-5369
>             Project: HBase
>          Issue Type: Improvement
>          Components: BlockCache, Compaction
>            Reporter: Liyin Tang
>            Assignee: Liyin Tang
>
> HBase reserves a large set memory for the block cache and the cached blocks will be age
out in a LRU fashion. Obviously, we don't want to age out the blocks which are still hot.
However, when the compactions are starting, these hot blocks may naturally be invalid. Considering
that the block cache has already known which HFiles these hot blocks come from, the compaction
selection algorithm could just simply skip compact these HFiles until these block cache become
cold.
> For example, if there is a HFile and 80% of blocks for this HFile is be cached, which
means this HFile is really hot, then just skip this HFile during the compaction selection.
> The percentage of hot blocks should be configured as a high bar to make sure that HBase
are still making progress for the compaction.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message