flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Congxian Qiu <qcx978132...@gmail.com>
Subject Re: Flink Key based watermarks with event time
Date Fri, 15 May 2020 11:16:41 GMT
Hi

Maybe you can try KeyedProcessFunction[1] for this, but you need to handle
the allow-latency logic[2] in your own business logic(event-time records
maybe out-of-order)

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/stream/operators/process_function.html#the-keyedprocessfunction
[2]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/stream/operators/windows.html#allowed-lateness
Best,
Congxian


Gnanasoundari Soundarajan <gnanasoundari.soundarajan@man-es.com>
于2020年5月14日周四 下午12:10写道:

> Hi all,
>
>
>
> We have a requirement where we need to maintain key based watermarks with *event
> time*. Each sensor will communicate with different timestamp where we
> need to maintain watermark separately for each sensor. Is this requirement
> can be achieved with Flink?
>
>
>
> Thanks.
>
>
>
> Regards,
>
> Gnana
>

Mime
View raw message