kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuancheng PENG (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6717) TopicPartition Assined twice to a consumer group for different consumers
Date Tue, 27 Mar 2018 09:29:00 GMT
Yuancheng PENG created KAFKA-6717:
-------------------------------------

             Summary: TopicPartition Assined twice to a consumer group for different consumers

                 Key: KAFKA-6717
                 URL: https://issues.apache.org/jira/browse/KAFKA-6717
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.11.0.1
            Reporter: Yuancheng PENG


I'm using \{{StickyAssignor}} for consuming more than 100 topics with certain pattern.

There are 10 consumers with the same group id.

I expected that topic-partition to be assigned to only one consumer instance. However some
topic partitions are assigned twice in 2 different difference instance, hence the consumer
group process duplicate messages.
{code:java}
props.put(ConsumerConfig.PARTITION_ASSIGNMENT_STRATEGY_CONFIG, Collections.singletonList(StickyAssignor.class));

KafkaConsumer<Record, Record> c = new KafkaConsumer<>(props);
c.subscribe(Pattern.compile(TOPIC_PATTERN), new NoOpConsumerRebalanceListener());
{code}
 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message