hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers
Date Wed, 08 Jun 2016 22:25:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15321562#comment-15321562
] 

Carlo Curino commented on YARN-5215:
------------------------------------

Bar proper synching with YARN-1011 and YARN-5202 efforts and polishing the patch to include
tests and conf switches, 
I am very supportive of this effort. It seems a rather simple change that can deal with a
broad set of issues when YARN 
is not the only thing running on a set of machines.  The fact that you have been running this
for a while is also reassuring. 
Were those prod clusters? Scale? 

Please provide a cleaned-up version of the patch, and comment on [~jlowe] comment.

[~jlowe] would you be ok with this going in? Can you build upon it for the work you are doing
or is it horribly incompatible?  

> Scheduling containers based on external load in the servers
> -----------------------------------------------------------
>
>                 Key: YARN-5215
>                 URL: https://issues.apache.org/jira/browse/YARN-5215
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Inigo Goiri
>         Attachments: YARN-5215.000.patch
>
>
> Currently YARN runs containers in the servers assuming that they own all the resources.
The proposal is to use the utilization information in the node and the containers to estimate
how much is consumed by external processes and schedule based on this estimation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message