kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apurva Mehta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-5251) Producer should drop queued sends when transaction is aborted
Date Wed, 24 May 2017 20:14:04 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-5251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023603#comment-16023603
] 

Apurva Mehta commented on KAFKA-5251:
-------------------------------------

Raising this to blocker status. Currently, if there are fatal errors for things like `AddPartitionsToTxn`,
we will keep requeuing this requset with the pending partitions. Even if the user aborts the
transactions, we will try to flush the pending `AddPartitions`. If the underlying error is
not going to be resolved with retries, then this will go on forever, and the transaction can
never abort. 

So we need to be drop pending transactional requests at a minimum when we are in an 'ABORTING_TRANSACTION`
state so that the abort can be successfully completed. 

> Producer should drop queued sends when transaction is aborted
> -------------------------------------------------------------
>
>                 Key: KAFKA-5251
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5251
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: clients, core, producer 
>            Reporter: Jason Gustafson
>              Labels: exactly-once
>             Fix For: 0.11.0.0
>
>
> As an optimization, if a transaction is aborted, we can drop any records which have not
yet been sent to the brokers. However, to avoid the sequence number getting out of sync, we
need to continue sending any request which has been sent at least once.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message