kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Viliam Durina (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-5881) Consuming from added partitions without restarting the consumer
Date Wed, 13 Sep 2017 06:07:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Viliam Durina updated KAFKA-5881:
---------------------------------
    Description: 
Currently the {{KafkaConsumer}} is not able to return events from newly added partitions,
neither in automatic nor in manual assignment. I have to create a new consumer. This was a
surprise to me and [other users|https://stackoverflow.com/q/46175275/952135].

With manual assignment, the {{consumer.partitionsFor("topic")}} should eventually return new
partitions.

With automatic assignment, one of the consumers should start consuming from new partitions.

If this is technically not possible, it should at least be documented.

  was:
Currently the {{KafkaConsumer}} is not able to return events from newly added partitions,
neither in automatic nor in manual assignment. I have to create a new consumer. This was a
surprise to me and [https://stackoverflow.com/q/46175275/952135|other users].

With manual assignment, the {{consumer.partitionsFor("topic")}} should eventually return new
partitions.

With automatic assignment, one of the consumers should start consuming from new partitions.

If this is technically not possible, it should at least be documented.


> Consuming from added partitions without restarting the consumer
> ---------------------------------------------------------------
>
>                 Key: KAFKA-5881
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5881
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>    Affects Versions: 0.11.0.0
>            Reporter: Viliam Durina
>
> Currently the {{KafkaConsumer}} is not able to return events from newly added partitions,
neither in automatic nor in manual assignment. I have to create a new consumer. This was a
surprise to me and [other users|https://stackoverflow.com/q/46175275/952135].
> With manual assignment, the {{consumer.partitionsFor("topic")}} should eventually return
new partitions.
> With automatic assignment, one of the consumers should start consuming from new partitions.
> If this is technically not possible, it should at least be documented.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message