flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kostas Kloudas (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (FLINK-6205) Put late elements in side output.
Date Fri, 31 Mar 2017 11:18:42 GMT

     [ https://issues.apache.org/jira/browse/FLINK-6205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Kostas Kloudas closed FLINK-6205.
    Resolution: Fixed

Merged with 48890285d4b1c285bebb971ae0dbfc310c6fcc0e

> Put late elements in side output.
> ---------------------------------
>                 Key: FLINK-6205
>                 URL: https://issues.apache.org/jira/browse/FLINK-6205
>             Project: Flink
>          Issue Type: Bug
>          Components: CEP
>    Affects Versions: 1.3.0
>            Reporter: Kostas Kloudas
>            Assignee: Kostas Kloudas
>             Fix For: 1.3.0
> Currently the CEP library had a somehow fuzzy way to handle late events. Essentially:
> 1) it accepts all events (late and early)
> 2) it sorts them based on event time
> 3) whenever a watermark arrives, it feeds them into the NFA.
> This does not respect event time, as late events are still processed.
> In addition, given that the order in which elements are processed matters, this could
lead to wrong results as events may be processed by the NFA out-of-order with respect to their
> This issue proposes to assume correctness of the watermark and consider as late, events
that arrive having  a timestamp smaller than that of the last seen watermark. In addition,
late events are not silently dropped, but the user can specify to send them to a side output,
as done in the case of the {{WindowOperator}}.

This message was sent by Atlassian JIRA

View raw message