kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dong Lin (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (KAFKA-5871) bound the throttle time in byte rate quota
Date Tue, 17 Oct 2017 03:14:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206951#comment-16206951
] 

Dong Lin edited comment on KAFKA-5871 at 10/17/17 3:13 AM:
-----------------------------------------------------------

[~junrao] Yeah I read that comment. I think the actual problem is worse than that. Let's say
the ProduceRequestSize size is 10MB, the window size is 10 sec and the quota provided by user
is 2 MB. The issue here is that, if user starts 10 producer with the same clientId, 10*10=100
MB data will be produced every 10 seconds, which translates to 10MBps throughput.

This means that broker is no longer protected by the quota regardless of the value of the
quota. Does this make sense?


was (Author: lindong):
[~junrao] Yeah I read that comment. I think the actual problem is worse than that. Let's say
the ProduceRequestSize size is 10MB, the window size is 10 sec and the quota provided by user
is 2 MB. The issue here is that, if user starts 10 producer with the same clientId, 10*10=100
MB data will be produced every 10 seconds, which translates to 10MBps throughput.

This means that broker is not longer protected by the quota regardless of the value of the
quota. Does this make sense?

> bound the throttle time in byte rate quota
> ------------------------------------------
>
>                 Key: KAFKA-5871
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5871
>             Project: Kafka
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 0.11.0.0
>            Reporter: Jun Rao
>
> Currently, if a user sets a very small byte rate quota, the calculated throttled time
can be higher than the request timeout in the client, which will cause the client request
to time out and be retried.
> On the other hand, for the request time quota, we bound the throttled time with the metric
window size. This prevents client timeout and seems to be better. We probably want to implement
the same thing in the byte rate quota.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message