kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Viliam Durina (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5881) Consuming from added partitions without restarting the consumer
Date Mon, 18 Sep 2017 09:11:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16169779#comment-16169779

Viliam Durina commented on KAFKA-5881:

Maybe it could be added to javadoc of {{partitionsFor}} (and possibly others), which currently
says just this:

bq. This method will issue a remote call to the server if it does not already have any metadata
about the given topic.

> Consuming from added partitions without restarting the consumer
> ---------------------------------------------------------------
>                 Key: KAFKA-5881
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5881
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>    Affects Versions:
>            Reporter: Viliam Durina
> Currently the {{KafkaConsumer}} is not able to return events from newly added partitions,
neither in automatic nor in manual assignment. I have to create a new consumer. This was a
surprise to me and [other users|https://stackoverflow.com/q/46175275/952135].
> With manual assignment, the {{consumer.partitionsFor("topic")}} should eventually return
new partitions.
> With automatic assignment, one of the consumers should start consuming from new partitions.
> If this is technically not possible, it should at least be documented.

This message was sent by Atlassian JIRA

View raw message