kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "NieWang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-3965) Mirror maker sync send fails will lose messages
Date Tue, 27 Sep 2016 03:49:20 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524965#comment-15524965

NieWang commented on KAFKA-3965:

The mirror maker version that I running is

You can follow the steps I described to verify the problem.

> Mirror maker sync send fails will lose messages
> -----------------------------------------------
>                 Key: KAFKA-3965
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3965
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions:
>         Environment: SUSE Linux Enterprise Server 11 (x86_64)
>            Reporter: NieWang
>             Fix For:
> 1、Source kafka cluster storage some messages and message size is 500 bytes.
> 2、Mirror maker producer config 
>      producer.type=sync    
>      max.request.size=400
> 3、Start mirror maker backup message from source kafka cluster to destination kafka
cluster, then mirror maker will quit because message larger than 400.
> 4、Check source kafka cluster will find offset have set to 1.
> 5、Check destination kafka cluster, then find have not any message.
> 6、Delete producer config max.request.size=400,start mirror maker again. Wait mirror
maker finish backup, then find have lose the first message.

This message was sent by Atlassian JIRA

View raw message