kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Guozhang Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-4133) Provide a configuration to control consumer max in-flight fetches
Date Sat, 23 Sep 2017 04:28:15 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Guozhang Wang updated KAFKA-4133:
---------------------------------
    Fix Version/s:     (was: 1.0.0)
                   1.1.0

> Provide a configuration to control consumer max in-flight fetches
> -----------------------------------------------------------------
>
>                 Key: KAFKA-4133
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4133
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>            Reporter: Jason Gustafson
>            Assignee: Mickael Maison
>             Fix For: 1.1.0
>
>
> With KIP-74, we now have a good way to limit the size of fetch responses, but it may
still be difficult for users to control overall memory since the consumer will send fetches
in parallel to all the brokers which own partitions that it is subscribed to. To give users
finer control, it might make sense to add a `max.in.flight.fetches` setting to limit the total
number of concurrent fetches at any time. This would require a KIP since it's a new configuration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message