kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sumant Tambe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5886) Introduce delivery.timeout.ms producer config (KIP-91)
Date Fri, 29 Sep 2017 20:41:00 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186378#comment-16186378
] 

Sumant Tambe commented on KAFKA-5886:
-------------------------------------

I think It's unlikely that this would merge in 1.0.0. It's a complex patch. There are a few
issues regarding tests that I've not had a chance to resolve. I plan to resume work next week.

I'm familiar with the heavy producer load case. That's how we ran into the expiry issue. We've
an internal patched version to work around that issue.

> Introduce delivery.timeout.ms producer config (KIP-91)
> ------------------------------------------------------
>
>                 Key: KAFKA-5886
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5886
>             Project: Kafka
>          Issue Type: Improvement
>          Components: producer 
>            Reporter: Sumant Tambe
>            Assignee: Sumant Tambe
>             Fix For: 1.0.0
>
>
> We propose adding a new timeout delivery.timeout.ms. The window of enforcement includes
batching in the accumulator, retries, and the inflight segments of the batch. With this config,
the user has a guaranteed upper bound on when a record will either get sent, fail or expire
from the point when send returns. In other words we no longer overload request.timeout.ms
to act as a weak proxy for accumulator timeout and instead introduce an explicit timeout that
users can rely on without exposing any internals of the producer such as the accumulator.

> See [KIP-91|https://cwiki.apache.org/confluence/display/KAFKA/KIP-91+Provide+Intuitive+User+Timeouts+in+The+Producer]
for more details.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message