flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vinay patil <vinay18.pa...@gmail.com>
Subject Re: How to let 1.1.3 not drop late events as verion 1.0.3 does
Date Tue, 29 Nov 2016 09:50:53 GMT
Yes, That's what I have done.

IMO flink should allow user to decide whether to discard late data or not
by having some flag, because for some cases users cannot afford to loose
any data.

Regards,
Vinay Patil

On Tue, Nov 29, 2016 at 3:16 PM, Maximilian Michels [via Apache Flink User
Mailing List archive.] <ml-node+s2336050n10362h74@n4.nabble.com> wrote:

> Setting allowedLateness to Long.MAX_VALUE and returning
> TriggerResult.FIRE_AND_PURGE in the custom trigger should do the
> trick.
>
> -Max
>
>
> On Mon, Nov 28, 2016 at 2:57 PM, vinay patil <[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=10362&i=0>> wrote:
>
> > Hi Sendoh,
> >
> > I have used the Custom Trigger which is same as 1.0.3 EventTimeTrigger,
> and
> > kept the allowedLateness value to Long.MAX_VALUE.
> > Because of this change the late elements are not discarded and become
> single
> > element windows
> >
> > Regards,
> > Vinay Patil
> >
> > On Mon, Nov 28, 2016 at 5:54 PM, Sendoh [via Apache Flink User Mailing
> List
> > archive.] <[hidden email]> wrote:
> >>
> >> Hi Flink users,
> >>
> >> Can I ask how to avoid default allowLateness(0) ? so that late events
> >> becomes single-element windows as 1.0.3 version acts?
> >>
> >> Best,
> >>
> >> Sendoh
> >>
> >> ________________________________
> >> If you reply to this email, your message will be added to the
> discussion
> >> below:
> >>
> >> http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/How-to-let-1-1-3-not-drop-late-events-as-
> verion-1-0-3-does-tp10349.html
> >> To start a new topic under Apache Flink User Mailing List archive.,
> email
> >> [hidden email]
> >> To unsubscribe from Apache Flink User Mailing List archive., click
> here.
> >> NAML
> >
> >
> >
> > ________________________________
> > View this message in context: Re: How to let 1.1.3 not drop late events
> as
> > verion 1.0.3 does
> >
> > Sent from the Apache Flink User Mailing List archive. mailing list
> archive
> > at Nabble.com.
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/How-to-let-1-1-3-not-drop-late-events-as-verion-1-0-3-does-
> tp10349p10362.html
> To start a new topic under Apache Flink User Mailing List archive., email
> ml-node+s2336050n1h83@n4.nabble.com
> To unsubscribe from Apache Flink User Mailing List archive., click here
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=dmluYXkxOC5wYXRpbEBnbWFpbC5jb218MXwxODExMDE2NjAx>
> .
> NAML
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/How-to-let-1-1-3-not-drop-late-events-as-verion-1-0-3-does-tp10349p10363.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.
Mime
View raw message