flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tamara Mendt <tammyme...@gmail.com>
Subject Broadcasting sets in Flink Streaming
Date Tue, 25 Aug 2015 09:15:19 GMT

I have been trying to use the function withBroadcastSet on a
SingleOutputStreamOperator (map) the same way I would on a MapOperator for
a DataSet. From what I see, this cannot be done. I wonder if there is some
way to broadcast a DataSet to the tasks that are performing transformations
on a DataStream?

I am basically pre-calculating some things with Flink which I later need
for the transformations on the incoming data from the stream. So I want to
broadcast the resulting datasets from the pre-calculations.

Any ideas on how to best approach this?

Thanks, cheers


View raw message