flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gyula Fora (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3386) Kafka consumers should not necessarily fail on expiring data
Date Thu, 11 Feb 2016 11:28:18 GMT
Gyula Fora created FLINK-3386:
---------------------------------

             Summary: Kafka consumers should not necessarily fail on expiring data
                 Key: FLINK-3386
                 URL: https://issues.apache.org/jira/browse/FLINK-3386
             Project: Flink
          Issue Type: Improvement
          Components: Streaming Connectors
    Affects Versions: 1.0.0
            Reporter: Gyula Fora


Currently if the data in a kafka topic expires while reading from it, it causes an unrecoverable
failure as subsequent retries will also fail on invalid offsets.

While this might be the desired behaviour under some circumstances, it would probably be better
in most cases to automatically jump to the earliest valid offset in these cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message