hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-1010) FairScheduler: decouple container scheduling from nodemanager heartbeats
Date Thu, 01 Aug 2013 16:21:48 GMT
Alejandro Abdelnur created YARN-1010:
----------------------------------------

             Summary: FairScheduler: decouple container scheduling from nodemanager heartbeats
                 Key: YARN-1010
                 URL: https://issues.apache.org/jira/browse/YARN-1010
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: scheduler
    Affects Versions: 2.1.0-beta
            Reporter: Alejandro Abdelnur
            Assignee: Alejandro Abdelnur
            Priority: Critical


Currently scheduling for a node is done when a node heartbeats.

For large cluster where the heartbeat interval is set to several seconds this delays scheduling
of incoming allocations significantly.

We could have a continuous loop scanning all nodes and doing scheduling. If there is availability
AMs will get the allocation in the next heartbeat after the one that placed the request.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message