kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ronald van de Kuil (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-6022) mirror maker stores offset in zookeeper
Date Wed, 11 Oct 2017 19:11:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200790#comment-16200790

Ronald van de Kuil commented on KAFKA-6022:

Hi Manikumar,

I am glad to have been of help.

I did clean the DC2 "cluster" and restarted the mirror maker with the following settings.


I see the new kafka based consumer using Kafka Tool but I do not see the offset.

The same goes for the command line:

pi@pi4:/opt/kafka_2.11- $ bin/kafka-consumer-groups.sh --describe --bootstrap-server
pi1:9092,pi2:9092 --new-consumer --group kafkaMirrorV2

Nothing shows in the table.

The mirror is not being established. 

It is not a big deal for me because it is just a setup for learning for me.

I edited the consumer.properties of the mirror maker a bit in the style of the consumer api.

Am I missing something here?

> mirror maker stores offset in zookeeper
> ---------------------------------------
>                 Key: KAFKA-6022
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6022
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Ronald van de Kuil
>            Priority: Minor
> I happened to notice that the mirror maker stores its offset in zookeeper. 
> I do not see it using:
> bin/kafka-consumer-groups.sh --bootstrap-server pi1:9092 --new-consumer --list
> I do however see consumers that store their offset in kafka.
> I would guess that storing the offset in zookeeper is old style?
> Would it be an idea to update the mirror maker to the new consumer style?

This message was sent by Atlassian JIRA

View raw message