flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sendoh <unicorn.bana...@gmail.com>
Subject Re: TimeWindowAll doeesn't assign properly
Date Mon, 29 Aug 2016 10:11:53 GMT
Hi,

As I found, the problem was rebalance() because the data arrives in 1 minute
(it re-processes old events) and it's a bit strange that when configured
watermark as 10 minutes it worked. 
After removing rebalance(), it works as expected that setting watermark
less.

DataStream<JSONObject> streams = env.addSource(
                new FlinkKafkaConsumer09<>(topicList, new JSONSchema(),
properties))
                *.rebalance()*
                .assignTimestampsAndWatermarks(new CorrelationWatermark());

Best,

Sendoh



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/TimeWindowAll-doeesn-t-assign-properly-with-EventTime-tp8201p8754.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Mime
View raw message