hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Yan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-1290) Let continuous scheduling achieve more balanced task assignment
Date Thu, 10 Oct 2013 20:21:41 GMT
Wei Yan created YARN-1290:
-----------------------------

             Summary: Let continuous scheduling achieve more balanced task assignment
                 Key: YARN-1290
                 URL: https://issues.apache.org/jira/browse/YARN-1290
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Wei Yan
            Assignee: Wei Yan


Currently, in continuous scheduling (YARN-1010), in each round, the thread iterates over pre-ordered
nodes and assigns tasks. This mechanism may overload the first several nodes, while the latter
nodes have no tasks.

We should sort all nodes according to available resource. In each round, always assign tasks
to nodes with larger capacity, which can balance the load distribution among all nodes.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message