reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dhruv Mahajan <dhruv.maha...@gmail.com>
Subject Re: IMRU usage question
Date Fri, 20 May 2016 22:04:38 GMT
For example,, maintain model, maintain gradient history for LBFGS etc. My
question is if it is already doing it and in addition it also knows what it
needs to do next and hence sort of simulates AllReduce vs. master still
telling him what to do, is there preference of one over another.

On Fri, May 20, 2016 at 2:41 PM, Markus Weimer <markus@weimo.de> wrote:

> On 2016-05-20 1:54 PM, Dhruv Mahajan wrote:
>
>> b) Mappers need to maintain state form one iteration to next.
>>
>
> What sort of state are you referring to? Stuff of the size of the model or
> literally state like "in the next round, I need to compute a gradient"
>
> Markus
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message