kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matthias J. Sax (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (KAFKA-6190) GlobalKTable never finishes restoring when consuming transactional messages
Date Thu, 09 Nov 2017 00:21:01 GMT

     [ https://issues.apache.org/jira/browse/KAFKA-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Matthias J. Sax updated KAFKA-6190:
-----------------------------------
    Fix Version/s: 1.1.0

> GlobalKTable never finishes restoring when consuming transactional messages
> ---------------------------------------------------------------------------
>
>                 Key: KAFKA-6190
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6190
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 0.11.0.1, 1.0.0
>         Environment: Linux
>            Reporter: Alex Good
>             Fix For: 0.11.0.2, 1.1.0, 1.0.1
>
>
> When creating a GlobalKTable from a topic that contains messages that were produced in
a transaction the GlobalStreamThread never finishes restoring the table. This appears to be
because the `GlobalStateManagerImpl#restoreState` method fails to take into account the transaction
markers in it's calculation of it's offset when reading messages and so never reaches the
high watermark for the topic it is restoring.
> To demonstrate the issue produce a few messages in a transaction to a topic, then attempt
to restore a GlobalKTable from that topic, the store will never complete restoring.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message