flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (FLINK-3428) Add fixed time trailing timestamp/watermark extractor
Date Thu, 28 Apr 2016 13:50:13 GMT

     [ https://issues.apache.org/jira/browse/FLINK-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Robert Metzger resolved FLINK-3428.
       Resolution: Fixed
    Fix Version/s: 1.1.0

Resolved for 1.1.0 in http://git-wip-us.apache.org/repos/asf/flink/commit/6225aa6f

Thanks for the contribution! 

> Add fixed time trailing timestamp/watermark extractor
> -----------------------------------------------------
>                 Key: FLINK-3428
>                 URL: https://issues.apache.org/jira/browse/FLINK-3428
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Robert Metzger
>            Assignee: Kostas Kloudas
>             Fix For: 1.1.0
> Flink currently provides only one build-in timestamp extractor, which assumes strictly
ascending timestamps. In real world use cases, timestamps are almost never strictly ascending.
> Therefore, I propose to provide an utility watermark extractor which is generating watermarks
with a fixed-time trailing.
> The implementation should keep track of the highest event-time seen so far and subtract
a fixed amount of time from that event time.
> This way, users can for example specify that the watermarks should always "lag behind"
10 minutes.

This message was sent by Atlassian JIRA

View raw message