reef-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boris Shulman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (REEF-936) Support scale-down in REEF
Date Fri, 06 May 2016 14:48:12 GMT

    [ https://issues.apache.org/jira/browse/REEF-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274149#comment-15274149
] 

Boris Shulman commented on REEF-936:
------------------------------------

I generally agree with this. Need to think of a details. For example for teh submisison runtmime
it is not really YarnClientConfiguration but ExtensibleYarnClientConfiguration that allows
bindning different driver configuration provider. I would prefer not to expose it to the users.
We should create another sub jira for this work.
WDYT?

> Support scale-down in REEF
> --------------------------
>
>                 Key: REEF-936
>                 URL: https://issues.apache.org/jira/browse/REEF-936
>             Project: REEF
>          Issue Type: Improvement
>          Components: REEF
>            Reporter: Markus Weimer
>            Assignee: Boris Shulman
>
> The minimal useful REEF job right now consists of two containers: One for the Driver
and one for the Evaluator. This is a fitting design for applications that need to scale out.
> However, some apps might need to be elastic to workloads the size of a single Task, at
which point the overhead for the Driver becomes substantial.
> While there is no plan of action yet, let's use this JIRA as the link target for future
work towards this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message