hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zian Chen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-8178) [Umbrella] Resource Over-commitment Based on Opportunistic Container Preemption
Date Wed, 18 Apr 2018 22:01:00 GMT
Zian Chen created YARN-8178:

             Summary: [Umbrella] Resource Over-commitment Based on Opportunistic Container
                 Key: YARN-8178
                 URL: https://issues.apache.org/jira/browse/YARN-8178
             Project: Hadoop YARN
          Issue Type: New Feature
          Components: capacity scheduler
            Reporter: Zian Chen

We want to provide an opportunistic container-based solution to achieve more aggressive preemption
with shorter preemption monitoring interval. 

Instead of allowing applications to allocate resources with a mix of guaranteed and opportunistic
containers, we allow newly submitted applications to only contain guaranteed containers. Meanwhile,
we change the preemption logic to, instead of killing containers, demote guaranteed containers
into opportunistic ones, so that when there are new applications submitted, we can ensure
that these containers can be launched by preempting opportunistic containers.

This approach is related to YARN-1011 but achieves ver-commitment in a different way, however,
we rely on opportunistic container part implemented in YARN-1011 to make our design work well. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message