kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "huxihx (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-6524) kafka mirror can't producer internal topic
Date Wed, 07 Feb 2018 13:44:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16355451#comment-16355451

huxihx commented on KAFKA-6524:

[~omkreddy] Sorry to mistake you for the reporter:)

[~ahmed.madkour] Like what Manikumar mentioned, all PRODUCE requests with this client ID will
be accepted and processed by the broker, even for internal topics.

> kafka mirror can't producer internal topic 
> -------------------------------------------
>                 Key: KAFKA-6524
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6524
>             Project: Kafka
>          Issue Type: Bug
>          Components: producer 
>    Affects Versions: 1.0.0
>            Reporter: Ahmed Madkour
>            Priority: Minor
> We are using kafka-mirror-maker.sh to consume data from a 3 brokers kafka cluster and
producer the data to another single broker kafka cluster
> We want to include internal topics so we added the following in the consumer configuration
> exclude.internal.topics=false
> We keep receiving the following errors:
> {code:java}
> org.apache.kafka.common.errors.InvalidTopicException: The request attempted to perform
an operation on an invalid topic.
>  ERROR Error when sending message to topic __consumer_offsets with key: 43 bytes, value:
28 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> {code}
> It seems that the producer can't access the internal topic __consumer_offsets.
> Any way to fix that?

This message was sent by Atlassian JIRA

View raw message