hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alan Gates (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12376) make hive.compactor.worker.threads use a thread pool, etc
Date Tue, 10 Nov 2015 19:01:11 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999120#comment-14999120
] 

Alan Gates commented on HIVE-12376:
-----------------------------------

The default min/max for server threads in the metastore is 200/1000.  Given that we don't
want compaction to eat too many metastore resources it would seem to make sense to set the
limit as a percentage of the maximum (maybe 10%?).

> make hive.compactor.worker.threads use a thread pool, etc
> ---------------------------------------------------------
>
>                 Key: HIVE-12376
>                 URL: https://issues.apache.org/jira/browse/HIVE-12376
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore, Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>
> # use a thread pool with core/max capacities instead of creating all threads upfront
> # make sure there is a limit (1000 threads?)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message