reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruv Mahajan <dhruv.maha...@gmail.com>
Subject Re: how to send message from task to driver
Date Wed, 08 Jun 2016 17:22:46 GMT
Just to give u an example, consider a parameter server where we have many
workers but we still want to control the degree of parallelism. With
Zookeeper it will be extremely easy to do this dynamically.

Dhruv

On Wed, Jun 8, 2016 at 10:21 AM, Markus Weimer <markus@weimo.de> wrote:

> On 2016-06-08 10:15, Dhruv Mahajan wrote:
>
>> Agreed...But since you mentioned it, hundreds of scenarios ran in my mind
>> in ML where this will make life much easier. So if its not too much an
>> effort I am inclined for its REEF integration in very near future.
>>
>
> +1 on that. If we can find the time, having ZooKeeper as a service run on
> a bunch of Evaluators has been a long-standing dream :)
>
> Markus
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message