hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14272) Enforce major compaction on stores with KEEP_DELETED_CELLS=true
Date Sun, 06 Sep 2015 17:41:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14732474#comment-14732474

Andrew Purtell commented on HBASE-14272:

Well, for MIN_VERSIONS we could also track the number of versions for a cell and not record
metadata (or record an additional flag) so as to not trigger compaction selection if the expired
cell must be retained. Anyway, disabling the early skip when we know the set of live cells
will change over time due to schema settings is simpler. This would need a release note because
it can increase compaction activity wherever people are using TTLs. 

> Enforce major compaction on stores with KEEP_DELETED_CELLS=true
> ---------------------------------------------------------------
>                 Key: HBASE-14272
>                 URL: https://issues.apache.org/jira/browse/HBASE-14272
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>             Fix For: 2.0.0
>         Attachments: HBASE-14272-v2.patch, HBASE-14272.patch
> Currently, if store has one (major compacted) file, the only case when major compaction
will be triggered for this file again - when locality is below threshold, defined by *hbase.hstore.min.locality.to.skip.major.compact*
or TTL expired some cells. If file has locality greater than this threshold it will never
be major compacted until Store's TTL kicks in. For CF with KEEP_DELETED_CELLS on, compaction
must be enabled always (even for single file), regardless of locality, when deleted cells
are expired (*hbase.hstore.time.to.purge.deletes*)

This message was sent by Atlassian JIRA

View raw message