flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Biplob Biswas <revolutioni...@gmail.com>
Subject Flink CEP not emitting timed out events properly
Date Fri, 16 Jun 2017 11:29:13 GMT

I am having some issues with FlinkCEP again. This time I am using processing
time for my CEP job where I am reading from multiple kafka topics and using
the pattern API to create a rule. I am outputting both, the matched events
as well as timeout events.

Now my problem is, I am sending some event over one of the topics such that
subsequent events wouldn't be generated within the time specified and I
expect a timed out event.

But it is not generating the timed out event even after 2 minutes (specified
interval) and it's only generating the previous timed out events when I am
sending an extra message over the kafka topic. 

I am not sure why is this happening, for example:

2> RecordReadEventType 1483278179000 044023a4-edec-439c-b221-806740972da2 []
2> RecordReadEventType 1483278179000 044023a4-edec-439c-b221-806740972da1 []
2> RecordReadEventType 1483278179000 044023a4-edec-439c-b221-806740972da5 []
2> Anomaly Events: {first=[RecordReadEventType 1483278179000
044023a4-edec-439c-b221-806740972da2 []]} @ 1497612386342
2> Anomaly Events: {first=[RecordReadEventType 1483278179000
044023a4-edec-439c-b221-806740972da1 []]} @ 1497612386342

in the example above, the anomaly events are generated only after sending
the event with event id - 044023a4-edec-439c-b221-806740972da5 

and that too the anomaly event for this particular event is not generated.

I suspected that the watermark was not updated automatically for the last
event and it's only updated when a new event comes in the system. So, I
added the setAutoWatermarkInterval(1000) to the code but no avail.

Thanks & Regards,
Biplob Biswas

View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-CEP-not-emitting-timed-out-events-properly-tp13794.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

View raw message