reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Shulman (JIRA)" <>
Subject [jira] [Commented] (REEF-936) Support scale-down in REEF
Date Fri, 06 May 2016 14:48:12 GMT


Boris Shulman commented on REEF-936:

I generally agree with this. Need to think of a details. For example for teh submisison runtmime
it is not really YarnClientConfiguration but ExtensibleYarnClientConfiguration that allows
bindning different driver configuration provider. I would prefer not to expose it to the users.
We should create another sub jira for this work.

> Support scale-down in REEF
> --------------------------
>                 Key: REEF-936
>                 URL:
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF
>            Reporter: Markus Weimer
>            Assignee: Boris Shulman
> The minimal useful REEF job right now consists of two containers: One for the Driver
and one for the Evaluator. This is a fitting design for applications that need to scale out.
> However, some apps might need to be elastic to workloads the size of a single Task, at
which point the overhead for the Driver becomes substantial.
> While there is no plan of action yet, let's use this JIRA as the link target for future
work towards this.

This message was sent by Atlassian JIRA

View raw message