hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-18083) Make large/small file clean thread number configurable in HFileCleaner
Date Thu, 06 Jul 2017 06:43:00 GMT

     [ https://issues.apache.org/jira/browse/HBASE-18083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Yu Li updated HBASE-18083:
    Attachment: HBASE-18083.v3.patch

New patch won't do real actions when no config changes on HFileCleaner. Make it at a not-that-fine
granularity that we restart all threads if only large thread number changes, which we may
further improve later if find it necessary.

[~chia7712] Let me know your thoughts on the v3 patch, thanks.

> Make large/small file clean thread number configurable in HFileCleaner
> ----------------------------------------------------------------------
>                 Key: HBASE-18083
>                 URL: https://issues.apache.org/jira/browse/HBASE-18083
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Yu Li
>            Assignee: Yu Li
>             Fix For: 3.0.0
>         Attachments: HBASE-18083.patch, HBASE-18083.v2.patch, HBASE-18083.v3.patch
> Currently we have only one thread for both large and small file cleaning, but when write
pressure is huge we might need more cleaner threads, so we need to make the thread number
> We observed more than 1.8PB data in archive directory online due to business access rate
change, and this proposal is one of the necessary changes required.
> Default value of the configurations would still be left to 1 to keep low pressure to
NN for normal case.

This message was sent by Atlassian JIRA

View raw message