kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Umesh Chaudhary (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5057) "Big Message Log"
Date Fri, 14 Apr 2017 04:18:41 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968580#comment-15968580
] 

Umesh Chaudhary commented on KAFKA-5057:
----------------------------------------

Understood and yes this is a good idea to capture the frequency of "Big Messages" on broker.
That new broker config would set the threshold and the produced messages which exceed that
threshold, broker would log their details. Also, I can start preparing KIP for this feature.


> "Big Message Log"
> -----------------
>
>                 Key: KAFKA-5057
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5057
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Gwen Shapira
>
> Really large requests can cause significant GC pauses which can cause quite a few other
symptoms on a broker. Will be nice to be able to catch them.
> Lets add the option to log details (client id, topic, partition) for every produce request
that is larger than a configurable threshold.
> /cc [~apurva]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message