Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
MIME-Version: 1.0
In-Reply-To: <CA+faj9ypkqK7hBFwvCsyRELRVq2pvjNFBEpkdP12cqTyavQ9fw@mail.gmail.com>
References: <3cd591b4-b7e9-60ec-65b7-4cb50cabfca1@cern.ch> <CAGco--bt9--skdF=Un0WTmoo3LPZD8aX2E5cqKJVAi0PXdV3Hg@mail.gmail.com>
 <CA+faj9ypkqK7hBFwvCsyRELRVq2pvjNFBEpkdP12cqTyavQ9fw@mail.gmail.com>
From: Maximilian Michels <mxm@apache.org>
Date: Fri, 29 Jul 2016 18:36:21 +0200
Message-ID: <CAGco--Znejj6wMNsEaKC_RGSLpjzFp5L3GCV2T=nbNWWfeiYEQ@mail.gmail.com>
Subject: Re: Discard out-of-order events
To: dev@flink.apache.org
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
archived-at: Fri, 29 Jul 2016 16:36:44 -0000

@Gyula: This is documented in the JavaDoc of the `allowedLateness(..)`
method and in the docs:
https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/windo=
ws.html#dealing-with-late-data

@Kevin: Thanks for the explanation, I'll get back to you soon (sort of
in a rush).

Cheers,
Max

On Fri, Jul 29, 2016 at 10:57 AM, Gyula F=C3=B3ra <gyula.fora@gmail.com> wr=
ote:
> Hi Max,
>
> So if I understand correctly the window operators now, by default,  disca=
rd
> late elements?
> Is this documented somewhere?
>
> Gyula
>
> Maximilian Michels <mxm@apache.org> ezt =C3=ADrta (id=C5=91pont: 2016. j=
=C3=BAl. 29., P,
> 10:40):
>
>> Hi!
>>
>> I'm not sure whether I understand your question. The purpose of Event
>> Time is to be able to process out-of-order events. Do you want to
>> discard late elements? In the upcoming Flink 1.1.0 you can set the
>> `allowedLateness` on a windowed stream. The default is 0, so late
>> elements are discarded; late elements are elements which arrive after
>> the Watermark has reached the operator.
>>
>> Cheers,
>> Max
>>
>> On Thu, Jul 28, 2016 at 6:49 PM, Kevin Jacobs <kevin.jacobs@cern.ch>
>> wrote:
>> > Is it possible to discard events that are out-of-order (in terms of ev=
ent
>> > time)?
>> >
>>