kafka-jira mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alex Good (JIRA)" <j...@apache.org>
Subject [jira] [Created] (KAFKA-6190) GlobalKTable never finishes restoring when consuming transactional messages
Date Wed, 08 Nov 2017 23:31:00 GMT
Alex Good created KAFKA-6190:
--------------------------------

             Summary: GlobalKTable never finishes restoring when consuming transactional messages
                 Key: KAFKA-6190
                 URL: https://issues.apache.org/jira/browse/KAFKA-6190
             Project: Kafka
          Issue Type: Bug
          Components: clients
         Environment: Linux
            Reporter: Alex Good


When creating a GlobalKTable from a topic that contains messages that were produced in a transaction
the GlobalStreamThread never finishes restoring the table. This appears to be because the
`GlobalStateManagerImpl#restoreState` method fails to take into account the transaction markers
in it's calculation of it's offset when reading messages and so never reaches the high watermark
for the topic it is restoring.

To demonstrate the issue produce a few messages in a transaction to a topic, then attempt
to restore a GlobalKTable from that topic, the store will never complete restoring.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message