kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chinmay Soman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-2477) Replicas spuriously deleting all segments in partition
Date Wed, 14 Oct 2015 20:05:07 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14957645#comment-14957645
] 

Chinmay Soman commented on KAFKA-2477:
--------------------------------------

[~ewencp] Totally agree. Its just that the current 0.8.2.0 version we're using : has been
"tampered" with. I see a lot of commits from our previous team here and I need to be careful
not to break anything. At the moment, I've applied the patch on top of our current version
and tested in staging. I'll be rolling it out on our biggest cluster soon to validate whether
it works.

> Replicas spuriously deleting all segments in partition
> ------------------------------------------------------
>
>                 Key: KAFKA-2477
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2477
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.8.2.1
>            Reporter: HÃ¥kon Hitland
>            Assignee: Jiangjie Qin
>             Fix For: 0.9.0.0
>
>         Attachments: Screen Shot 2015-10-10 at 6.54.44 PM.png, kafka_log.txt, kafka_log_trace.txt
>
>
> We're seeing some strange behaviour in brokers: a replica will sometimes schedule all
segments in a partition for deletion, and then immediately start replicating them back, triggering
our check for under-replicating topics.
> This happens on average a couple of times a week, for different brokers and topics.
> We have per-topic retention.ms and retention.bytes configuration, the topics where we've
seen this happen are hitting the size limit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message