flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Neumann <mneum...@spotify.com>
Subject load broadcast set into searchable set
Date Mon, 06 Oct 2014 09:57:03 GMT
Hej,

I have a Flink job with with a filter step. I now have a list of exceptions
where I need to do some extra work (300k data). I thought I just use a
boradcast set and then for each like compare if its in the exception set.

What is the best way to implement this in Flink? Is there an efficient way
of checking if a certain element is in the Broadcastset? Or can I somehow
dump the Broadcastset into a set?

cheers Martin

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message