flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Communicating between nodes at runtime
Date Mon, 20 Jul 2015 10:01:28 GMT
Hi Sachin,

Do you know about Broadcast Variables? They allow you to transfer a DataSet
to all nodes.


Let us know if that fits your needs.


On Fri, Jul 17, 2015 at 6:19 PM, Sachin Goel <sachingoel0101@gmail.com>

> Hi all
> Is it possible to send and receive key,value pairs at runtime? I would like
> to broadcast values at runtime so they are available on every node. This
> somehow seems essential for an implementation of Asynchronous batch
> iterations.
> What I would like is to have two functions in the RuntimeContext,
> broadcast(key,value) and receive(key).
> If such a thing doesn't exist now, how should I approach implementing it?
> Cheers!
> Sachin
> -- Sachin Goel
> Computer Science, IIT Delhi
> m. +91-9871457685

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message