flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yunfan123 <yunfanfight...@foxmail.com>
Subject Use processing time and time window flink acts like batch mode.
Date Wed, 12 Jul 2017 13:32:31 GMT
I using processing time and the data source comes from kafka.
My code is like follows:
    streams.keyBy(XXX)
               .timeWindow(Time.seconds(30))
               .apply(myClassObject)

Log in myClassObject is like:
2017-07-12 20:00:00,
2017-07-12 20:00:00,
........
2017-07-12 20:00:30,
2017-07-12 20:00:30,
...............
2017-07-12 20:01:00,
2017-07-12 20:01:00,

It means every 30 seconds, all of the window be triggered once.
And I'm sure the amounts of my key is very large.
So in the program based my time window length is 30, my expects is  :
key1: processing time 1
key2: processing time 1
key3: processing time 2
key4: processing time 3
The key1 and key2 should be processed in time 31.
The key3 should be processed in time 32.
The key4 should be processed in time 33.







--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Use-processing-time-and-time-window-flink-acts-like-batch-mode-tp14211.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message