kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "NieWang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-3965) Mirror maker sync send fails will lose messages
Date Tue, 27 Sep 2016 03:49:20 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15524965#comment-15524965
] 

NieWang commented on KAFKA-3965:
--------------------------------

The mirror maker version that I running is 0.10.0.0.

You can follow the steps I described to verify the problem.

> Mirror maker sync send fails will lose messages
> -----------------------------------------------
>
>                 Key: KAFKA-3965
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3965
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.10.0.0
>         Environment: SUSE Linux Enterprise Server 11 (x86_64)
>            Reporter: NieWang
>             Fix For: 0.10.1.0
>
>
> 1、Source kafka cluster storage some messages and message size is 500 bytes.
> 2、Mirror maker producer config 
>      producer.type=sync    
>      max.request.size=400
> 3、Start mirror maker backup message from source kafka cluster to destination kafka
cluster, then mirror maker will quit because message larger than 400.
> 4、Check source kafka cluster will find offset have set to 1.
> 5、Check destination kafka cluster, then find have not any message.
> 6、Delete producer config max.request.size=400,start mirror maker again. Wait mirror
maker finish backup, then find have lose the first message.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message