kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yuemeng (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-6421) consumer group can't show when use kafka-consumer-groups tool if the leader of __consumer_offsets partition for this group changed
Date Thu, 04 Jan 2018 04:03:00 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

yuemeng updated KAFKA-6421:
---------------------------
    Description: 
follow steps will reproduce this problem:
1)there is a 3 brokers kafka cluster,use kafka-console-consumer.sh to consumer one topic and
suppose group named "test-consumer-group",after a while, we stop consumer this topic.
2)suppose test-consumer-group will be write offset meta to partition 3 of __consumer_offsets,and
the leader of partition 3 is broker 1.
3) and we scale the cluster to 5 nodes ,and reassign partititons,and  leader of partition
3 is change to 0
4)then we use kafka-consumer-groups.sh --list can't show test-consumer-group,but the offset
meta still in topic __consumer_offsets
and i found that:
protocolType  will be change to empty for test-consumer-group after leader changed.
at last.
{code}
listAllGroupsFlattened.filter(_.protocolType == ConsumerProtocol.PROTOCOL_TYPE)
{code}
filter this test-consumer-group,so we can't use kafka-consumer-groups.sh to list it







  was:
follow steps will reproduce this problem:
1)there is a 3 brokers kafka cluster,use kafka-console-consumer.sh to consumer one topic and
suppose group named "test-consumer-group",after a while, we stop consumer this topic.
2)suppose test-consumer-group will be write offset meta to partition 3 of __consumer_offsets,and
the leader of partition 3 is broker 1.
3) and we scale the cluster to 5 nodes ,and reassign partititons,and  leader of partition
3 is change to 0
4)then we use kafka-consumer-groups.sh --list can't show test-consumer-group,but the offset
meta still in topic __consumer_offsets
and i found that:
protocolType  will be change to empty for test-consumer-group after leader changed.
at last.
{code}
listAllGroupsFlattened.filter(_.protocolType == ConsumerProtocol.PROTOCOL_TYPE)
{code/}
filter this test-consumer-group,so we can't use kafka-consumer-groups.sh to list it








> consumer group can't show when use kafka-consumer-groups tool if the leader of  __consumer_offsets
partition for this group changed
> -----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6421
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6421
>             Project: Kafka
>          Issue Type: Bug
>          Components: offset manager, tools
>    Affects Versions: 0.10.2.0, 0.11.0.1, 1.0.0
>            Reporter: yuemeng
>            Priority: Critical
>
> follow steps will reproduce this problem:
> 1)there is a 3 brokers kafka cluster,use kafka-console-consumer.sh to consumer one topic
and suppose group named "test-consumer-group",after a while, we stop consumer this topic.
> 2)suppose test-consumer-group will be write offset meta to partition 3 of __consumer_offsets,and
the leader of partition 3 is broker 1.
> 3) and we scale the cluster to 5 nodes ,and reassign partititons,and  leader of partition
3 is change to 0
> 4)then we use kafka-consumer-groups.sh --list can't show test-consumer-group,but the
offset meta still in topic __consumer_offsets
> and i found that:
> protocolType  will be change to empty for test-consumer-group after leader changed.
> at last.
> {code}
> listAllGroupsFlattened.filter(_.protocolType == ConsumerProtocol.PROTOCOL_TYPE)
> {code}
> filter this test-consumer-group,so we can't use kafka-consumer-groups.sh to list it



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message