flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Discard out-of-order events
Date Fri, 29 Jul 2016 16:36:21 GMT
@Gyula: This is documented in the JavaDoc of the `allowedLateness(..)`
method and in the docs:
https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/windows.html#dealing-with-late-data

@Kevin: Thanks for the explanation, I'll get back to you soon (sort of
in a rush).

Cheers,
Max

On Fri, Jul 29, 2016 at 10:57 AM, Gyula Fóra <gyula.fora@gmail.com> wrote:
> Hi Max,
>
> So if I understand correctly the window operators now, by default,  discard
> late elements?
> Is this documented somewhere?
>
> Gyula
>
> Maximilian Michels <mxm@apache.org> ezt írta (időpont: 2016. júl. 29., P,
> 10:40):
>
>> Hi!
>>
>> I'm not sure whether I understand your question. The purpose of Event
>> Time is to be able to process out-of-order events. Do you want to
>> discard late elements? In the upcoming Flink 1.1.0 you can set the
>> `allowedLateness` on a windowed stream. The default is 0, so late
>> elements are discarded; late elements are elements which arrive after
>> the Watermark has reached the operator.
>>
>> Cheers,
>> Max
>>
>> On Thu, Jul 28, 2016 at 6:49 PM, Kevin Jacobs <kevin.jacobs@cern.ch>
>> wrote:
>> > Is it possible to discard events that are out-of-order (in terms of event
>> > time)?
>> >
>>

Mime
View raw message