flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vasily Melnik <Vasily.Mel...@glowbyteconsulting.com>
Subject Initialization of broadcast state before processing main stream
Date Thu, 14 Nov 2019 05:28:04 GMT
Hi all.

In our task we have two Kafka topics:
- one with fact stream (web traffic)
- one with dimension

We would like to put dimension data into broadcast state and lookup on int
with facts. But we see that not all dimension records are put into state
before first fact record is processed, so lookup gives no data.

The question is: how could we read fact topic with some "delay" to give
dimension enough time to initialize state?

С уважением,
Василий Мельник

View raw message