hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eungsop Yoo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-15055) Major compaction is not triggered when both of TTL and hbase.hstore.compaction.max.size are set
Date Wed, 13 Jan 2016 02:27:39 GMT

     [ https://issues.apache.org/jira/browse/HBASE-15055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eungsop Yoo updated HBASE-15055:
--------------------------------
    Release Note: If the major compaction period has elapsed, we should run a major compaction
irrespective of hbase.hstore.compaction.max.size.  (was: Do not skip large files when the
sum of the size of TTL expired store files is greater than threshold. Major compaction should
be triggered to delete TTL expired records.

One parameter is added, "hbase.hstore.expired.size.ratio". When 0.0 is set to this parameter,
major compaction is triggered if there is any TTL expired records. When 1.0 is set, all of
large files are skipped regardless of the existence of TTL expired records. The default is
0.5, major compaction is triggered if above 50% of the store files in size have TTL expired
records.
)

> Major compaction is not triggered when both of TTL and hbase.hstore.compaction.max.size
are set
> -----------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15055
>                 URL: https://issues.apache.org/jira/browse/HBASE-15055
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Eungsop Yoo
>            Assignee: Eungsop Yoo
>            Priority: Minor
>         Attachments: HBASE-15055-v1.patch, HBASE-15055-v10.patch, HBASE-15055-v11.patch,
HBASE-15055-v2.patch, HBASE-15055-v3.patch, HBASE-15055-v4.patch, HBASE-15055-v5.patch, HBASE-15055-v6.patch,
HBASE-15055-v7.patch, HBASE-15055-v8.patch, HBASE-15055-v9.patch, HBASE-15055.patch
>
>
> Some large files may be skipped by hbase.hstore.compaction.max.size in candidate selection.
It causes skipping of major compaction. So the TTL expired records are still remained in the
disks and keep consuming disks.
> To resolve this issue, I suggest that to skip large files only if there is no TTL expired
record.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message