hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reid Chan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-19306) Avoid thread flood when both LogCleaner and HFileCleaner support multi threads execution
Date Mon, 20 Nov 2017 13:55:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-19306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259255#comment-16259255
] 

Reid Chan commented on HBASE-19306:
-----------------------------------

I have come up some ideas,
# since both cleaners share the same {{hbase.master.cleaner.interval}}, we can separate them
by using different configs, like {{hbase.master.hfile.cleaner.interval}} and {{hbase.master.wal.cleaner.interval}}.
# or we can make use of the {{initialDelay}} which is not used by either of the cleaner chore.

Any thoughts?

> Avoid thread flood when both LogCleaner and HFileCleaner support multi threads execution
> ----------------------------------------------------------------------------------------
>
>                 Key: HBASE-19306
>                 URL: https://issues.apache.org/jira/browse/HBASE-19306
>             Project: HBase
>          Issue Type: Improvement
>          Components: wal
>            Reporter: Reid Chan
>
> As discussion in HBASE-18309, it is possible that thread flood occurs when {{LogCleaner}}
and {{HFileCleaner}} start their responsibility simultaneously in HMaster, worse case would
drag NameNode down which would be the most unpleasant situation.
> We shall find a way to minimize the probability of that, or the better case, avoid that
happening.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message