kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "huxi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-4505) Cannot get topic lag since kafka upgrade from to
Date Wed, 14 Dec 2016 01:53:58 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15746918#comment-15746918

huxi commented on KAFKA-4505:

I don't think it's a good solution. The path you created in Zookeeper should have been an
ephemeral znode which is used to dynamically marks the ownership of a consumer instance, but
it would have not been able to do this if it were a persistent znode. 

Could you help confirm this: 
1. First remove the znodes you manually created by rmr /cosumers/log_level_export2_group_deduplicating/ids
and rmr /cosumers/log_level_export2_group_deduplicating/owners
2. Run the old consumer with the same group id 'rmr /cosumers/log_level_export2_group_deduplicating/ids'
and keep it running
3. Check whether ids and owners have been created under /consumers/log_level_export2_group_deduplicating

> Cannot get topic lag since kafka upgrade from to
> -----------------------------------------------------------------
>                 Key: KAFKA-4505
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4505
>             Project: Kafka
>          Issue Type: Bug
>          Components: consumer, metrics, offset manager
>    Affects Versions:
>            Reporter: Romaric Parmentier
>            Priority: Critical
> We were using kafka and we just migrate to version
> Since we migrate we are using the new script kafka-consumer-groups.sh to retreive topic
lags but it don't seem to work anymore. 
> Because the application is using the 0.8 driver we have added the following conf to each
kafka servers:
> log.message.format.version=0.8.2
> inter.broker.protocol.version=
> When I'm using the option --list with kafka-consumer-groups.sh I can see every consumer
groups I'm using but the --describe is not working:
> /usr/share/kafka$ bin/kafka-consumer-groups.sh --zookeeper ip:2181 --describe --group
> No topic available for consumer group provided
> GROUP                          TOPIC                          PARTITION  CURRENT-OFFSET
> When I'm looking into zookeeper I can see the offset increasing for this consumer group.
> Any idea ?

This message was sent by Atlassian JIRA

View raw message