flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles-Antoine Mathieu <charles-antoine.math...@corp.ovh.com>
Subject Window on stream with timestamps ascending by key
Date Thu, 17 Mar 2016 10:21:14 GMT
I wonder how to work with a stream with event timestamps ascending by key.

I can have a huge time skew between different keys, for example if I (re)connect an event
producer,
it will send all buffered results possibly from the last days.

Is it possible to trigger the window computation per key ?

Example with a window of 5 seconds and the window function being the count of the timestamps
:

KEY1 1000
KEY1 1001
KEY1 1002
KEY2    1
KEY2    2
KEY2    3
KEY2    4
KEY2    5
KEY2 window => 15
KEY1 1003
KEY2    6
KEY2    7
KEY2    8
KEY2    9
KEY2   10
KEY2 window => 40
KEY1 1004
KEY2   11
KEY2   12
KEY2   13
KEY2   14
KEY2   15
KEY2 window => 65
KEY1 1005
KEY1 window => 5015
...



Mime
View raw message