hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5830) Avoid preempting AM containers
Date Wed, 28 Dec 2016 23:48:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15784024#comment-15784024

Yufei Gu commented on YARN-5830:

[~kasha], thanks for the review. 
The high-level approach:
1. In first nodes, sort the containersToCheck list by putting all non-AM containers first.

2. We check containers one by one. If we are lucky to found a solution without any AM container,
just return the container list. But not lucky and we find a solution with AM container, we
record this solution in {{potentialContainers}} and {{break}} here to move to next node because
we may find an solution without AM container in next node.
3. Repeat step 1 and 2 for each node, the only difference is if we've already got a solution
with AM container, we can {{break}} the loop once we meet first AM container. 
4. Return the {{potentialContainers}} if we cannot find any solution without AM containers.

> Avoid preempting AM containers
> ------------------------------
>                 Key: YARN-5830
>                 URL: https://issues.apache.org/jira/browse/YARN-5830
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: fairscheduler
>            Reporter: Karthik Kambatla
>            Assignee: Yufei Gu
>         Attachments: YARN-5830.001.patch
> While considering containers for preemption, avoid AM containers unless absolutely necessary.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message