hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu Li (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HBASE-18083) Make large/small file clean thread number configurable in HFileCleaner
Date Fri, 19 May 2017 18:49:04 GMT
Yu Li created HBASE-18083:
-----------------------------

             Summary: Make large/small file clean thread number configurable in HFileCleaner
                 Key: HBASE-18083
                 URL: https://issues.apache.org/jira/browse/HBASE-18083
             Project: HBase
          Issue Type: Bug
            Reporter: Yu Li
            Assignee: Yu Li


Currently we have only one thread for both large and small file cleaning, but when write pressure
is huge we might need more cleaner threads, so we need to make the thread number configurable.

We observed more than 1.8PB data in archive directory online due to business access rate change,
and this proposal is one of the necessary changes required.

Default value of the configurations would still be left to 1 to keep low pressure to NN for
normal case.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message