hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bikas Saha (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers
Date Sun, 21 Feb 2016 03:07:18 GMT

    [ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155867#comment-15155867

Bikas Saha commented on YARN-1011:

2.3. Whats the reasoning behind this? Over-allocating a node seems to be a local decision
based on the nodes expected and actual utilization. So I would expect the logic to be something
similar to 1) Node is already 100% allocated 2) Actual utilization is < 80% 3) Over-allocate
to bring actual utilization ~=80%.

3. What is the AM/RM interaction in this promotion?
3.2. Not clear what is actually happening here? Will new container be allocated and the opportunistic
container allowed to continue till is exits or is preempted?

How does all this interact with preemption?

> [Umbrella] Schedule containers based on utilization of currently allocated containers
> -------------------------------------------------------------------------------------
>                 Key: YARN-1011
>                 URL: https://issues.apache.org/jira/browse/YARN-1011
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Arun C Murthy
>         Attachments: yarn-1011-design-v0.pdf, yarn-1011-design-v1.pdf, yarn-1011-design-v2.pdf
> Currently RM allocates containers and assumes resources allocated are utilized.
> RM can, and should, get to a point where it measures utilization of allocated containers
and, if appropriate, allocate more (speculative?) containers.

This message was sent by Atlassian JIRA

View raw message