flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3428) Add fixed time trailing timestamp/watermark extractor
Date Wed, 17 Feb 2016 11:04:18 GMT
Robert Metzger created FLINK-3428:
-------------------------------------

             Summary: Add fixed time trailing timestamp/watermark extractor
                 Key: FLINK-3428
                 URL: https://issues.apache.org/jira/browse/FLINK-3428
             Project: Flink
          Issue Type: Improvement
            Reporter: Robert Metzger


Flink currently provides only one build-in timestamp extractor, which assumes strictly ascending
timestamps. In real world use cases, timestamps are almost never strictly ascending.

Therefore, I propose to provide an utility watermark extractor which is generating watermarks
with a fixed-time trailing.

The implementation should keep track of the highest event-time seen so far and subtract a
fixed amount of time from that event time.

This way, users can for example specify that the watermarks should always "lag behind" 10
minutes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message