flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-3428) Add fixed time trailing timestamp/watermark extractor
Date Wed, 17 Feb 2016 11:04:18 GMT
Robert Metzger created FLINK-3428:

             Summary: Add fixed time trailing timestamp/watermark extractor
                 Key: FLINK-3428
                 URL: https://issues.apache.org/jira/browse/FLINK-3428
             Project: Flink
          Issue Type: Improvement
            Reporter: Robert Metzger

Flink currently provides only one build-in timestamp extractor, which assumes strictly ascending
timestamps. In real world use cases, timestamps are almost never strictly ascending.

Therefore, I propose to provide an utility watermark extractor which is generating watermarks
with a fixed-time trailing.

The implementation should keep track of the highest event-time seen so far and subtract a
fixed amount of time from that event time.

This way, users can for example specify that the watermarks should always "lag behind" 10

This message was sent by Atlassian JIRA

View raw message