kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anna Povzner (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-8480) Clients may fetch incomplete set of topic partitions during cluster startup
Date Tue, 04 Jun 2019 20:00:00 GMT
Anna Povzner created KAFKA-8480:
-----------------------------------

             Summary: Clients may fetch incomplete set of topic partitions during cluster
startup
                 Key: KAFKA-8480
                 URL: https://issues.apache.org/jira/browse/KAFKA-8480
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 2.2.1
            Reporter: Anna Povzner
            Assignee: Anna Povzner


KafkaConsumer#partitionsFor() or AdminClient#describeTopics() may return not all partitions
for a given topic when the cluster is starting up (after cluster was down). 

The cause is controller, on becoming a controller, sending UpdateMetadataRequest for all partitions
with at least one online replica, and then a separate UpdateMetadataRequest for all partitions
with at least one offline replica. If client sends metadata request in between broker processing
those two update metadata requests, clients will get incomplete set of partitions.

Proposed fix: controller should send one UpdateMetadataRequest (containing all partitions)
in  ReplicaStateMachine#startup().



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message