flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maximilian Michels <...@apache.org>
Subject Re: Communicating between nodes at runtime
Date Mon, 20 Jul 2015 10:01:28 GMT
Hi Sachin,

Do you know about Broadcast Variables? They allow you to transfer a DataSet
to all nodes.

https://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#broadcast-variables

Let us know if that fits your needs.

Cheers,
Max

On Fri, Jul 17, 2015 at 6:19 PM, Sachin Goel <sachingoel0101@gmail.com>
wrote:

> Hi all
> Is it possible to send and receive key,value pairs at runtime? I would like
> to broadcast values at runtime so they are available on every node. This
> somehow seems essential for an implementation of Asynchronous batch
> iterations.
>
> What I would like is to have two functions in the RuntimeContext,
> broadcast(key,value) and receive(key).
> If such a thing doesn't exist now, how should I approach implementing it?
>
> Cheers!
> Sachin
> -- Sachin Goel
> Computer Science, IIT Delhi
> m. +91-9871457685
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message