flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2974) Add periodic offset commit to Kafka Consumer if checkpointing is disabled
Date Thu, 05 Nov 2015 10:47:27 GMT
Robert Metzger created FLINK-2974:
-------------------------------------

             Summary: Add periodic offset commit to Kafka Consumer if checkpointing is disabled
                 Key: FLINK-2974
                 URL: https://issues.apache.org/jira/browse/FLINK-2974
             Project: Flink
          Issue Type: Improvement
          Components: Kafka Connector
            Reporter: Robert Metzger


Flink only writes the offsets from the consumer into ZK if checkpointing is enabled.

We should have a similar feature to Kafka's autocommit in our consumer.


Issue reported by user: http://stackoverflow.com/questions/33501574/flink-kafka-why-am-i-losing-messages



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message