hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abhishek Modi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-9697) Efficient allocation of Opportunistic containers.
Date Wed, 24 Jul 2019 19:28:00 GMT
Abhishek Modi created YARN-9697:
-----------------------------------

             Summary: Efficient allocation of Opportunistic containers.
                 Key: YARN-9697
                 URL: https://issues.apache.org/jira/browse/YARN-9697
             Project: Hadoop YARN
          Issue Type: Sub-task
            Reporter: Abhishek Modi
            Assignee: Abhishek Modi


In the current implementation, opportunistic containers are allocated based on the number
of queued opportunistic container information received in node heartbeat. This information
becomes stale as soon as more opportunistic containers are allocated on that node.

Allocation of opportunistic containers happens on the same heartbeat in which AM asks for
the containers. When multiple applications request for Opportunistic containers, containers
might get allocated on the same set of nodes as already allocated containers on the node are
not considered while serving requests from different applications. This can lead to uneven
allocation of Opportunistic containers across the cluster leading to increased queuing time 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message