flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "G.S.Vijay Raajaa" <gsvijayraa...@gmail.com>
Subject Purging Late stream data
Date Wed, 26 Jul 2017 02:37:06 GMT
Hi,

I am having 3 streams which is being merged from a union of kafka topics on
a given timestamp. The problem I am facing is that, if there is a delay  in
one of the stream and when the data in that particular stream arrives at a
later point in time, the merge happens in a delayed fashion. The way I want
to solve is that, I want to drop such data streams which comes after a
delay ( say 5sec ). Kindly direct me on how to go about it?

Will watermarking (to process in even time) + the allowed lateness help
solve the same?

Regards,
Vijay Raajaa G S

Mime
View raw message