kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ronald van de Kuil (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-6022) mirror maker stores offset in zookeeper
Date Wed, 11 Oct 2017 19:11:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200790#comment-16200790
] 

Ronald van de Kuil commented on KAFKA-6022:
-------------------------------------------

Hi Manikumar,

I am glad to have been of help.

I did clean the DC2 "cluster" and restarted the mirror maker with the following settings.

bootstrap.servers=pi1:9092,pi2:9092
group.id=kafkaMirrorV2
key.deserializer=org.apache.kafka.common.serialization.StringDeserializer
value.deserializer=org.apache.kafka.common.serialization.StringDeserializer

I see the new kafka based consumer using Kafka Tool but I do not see the offset.

The same goes for the command line:

pi@pi4:/opt/kafka_2.11-0.11.0.0 $ bin/kafka-consumer-groups.sh --describe --bootstrap-server
pi1:9092,pi2:9092 --new-consumer --group kafkaMirrorV2

Nothing shows in the table.

The mirror is not being established. 

It is not a big deal for me because it is just a setup for learning for me.

I edited the consumer.properties of the mirror maker a bit in the style of the consumer api.

Am I missing something here?



> mirror maker stores offset in zookeeper
> ---------------------------------------
>
>                 Key: KAFKA-6022
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6022
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Ronald van de Kuil
>            Priority: Minor
>
> I happened to notice that the mirror maker stores its offset in zookeeper. 
> I do not see it using:
> bin/kafka-consumer-groups.sh --bootstrap-server pi1:9092 --new-consumer --list
> I do however see consumers that store their offset in kafka.
> I would guess that storing the offset in zookeeper is old style?
> Would it be an idea to update the mirror maker to the new consumer style?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message