kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Gustafson (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-4133) Provide a configuration to control consumer max in-flight fetches
Date Tue, 06 Sep 2016 18:33:20 GMT
Jason Gustafson created KAFKA-4133:
--------------------------------------

             Summary: Provide a configuration to control consumer max in-flight fetches
                 Key: KAFKA-4133
                 URL: https://issues.apache.org/jira/browse/KAFKA-4133
             Project: Kafka
          Issue Type: Improvement
          Components: consumer
            Reporter: Jason Gustafson


With KIP-74, we now have a good way to limit the size of fetch responses, but it may still
be difficult for users to control overall memory since the consumer will send fetches in parallel
to all the brokers which own partitions that it is subscribed to. To give users finer control,
it might make sense to add a `max.in.flight.fetches` setting to limit the total number of
concurrent fetches at any time. This would require a KIP since it's a new configuration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message