kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Damien Gasparina (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-7129) Dynamic default value for number of thread configuration
Date Tue, 03 Jul 2018 08:22:00 GMT
Damien Gasparina created KAFKA-7129:
---------------------------------------

             Summary: Dynamic default value for number of thread configuration
                 Key: KAFKA-7129
                 URL: https://issues.apache.org/jira/browse/KAFKA-7129
             Project: Kafka
          Issue Type: Improvement
          Components: core
            Reporter: Damien Gasparina


There are properties in the broker to change the number of thread of a component (e.g. _num.replica.fetchers_
or _num.network.threads_). After discussing with [~astubbs], it seems that the default values
are optimized for an 8 CPU machine and might not be optimized for larger machine (e.g. 48
cores). 

For those larger machine, an admin need to tune them to be able to use all resources of the
host.

Having dynamic default value (e.g. _num.replica.fetchers = ceil(number of core / 8), etc...)
instead of static (e.g. _num.replica.fetchers =1) could be a more efficient strategy to have
default values optimized for different kind of deployment.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message