flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Griess, Andrew" <andrew.gri...@sap.com>
Subject global watermark across multiple kafka consumers
Date Tue, 15 Dec 2015 15:45:32 GMT
Hi guys,

I have a question related to utilizing watermarks with multiple FlinkKakfkaConsumer082 instances.
The aim is to have a global watermark across multiple kafka consumers where any message from
any kafka partition would update the same watermark. When testing a simple TimeStampExtractor
implementation it seems each consumer results in a separate watermark. Is there a prescribed
way of handling such a thing that anyone has any experience with?

Thanks for your help,

Andrew Griess


Mime
View raw message