hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1290) Let continuous scheduling achieve more balanced task assignment
Date Tue, 15 Oct 2013 00:18:42 GMT

    [ https://issues.apache.org/jira/browse/YARN-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794686#comment-13794686

Hadoop QA commented on YARN-1290:

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 2 new Findbugs (version
1.3.9) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-YARN-Build/2174//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-YARN-Build/2174//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2174//console

This message is automatically generated.

> Let continuous scheduling achieve more balanced task assignment
> ---------------------------------------------------------------
>                 Key: YARN-1290
>                 URL: https://issues.apache.org/jira/browse/YARN-1290
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Wei Yan
>            Assignee: Wei Yan
>         Attachments: main.pdf, YARN-1290.patch, YARN-1290.patch
> Currently, in continuous scheduling (YARN-1010), in each round, the thread iterates over
pre-ordered nodes and assigns tasks. This mechanism may overload the first several nodes,
while the latter nodes have no tasks.
> We should sort all nodes according to available resource. In each round, always assign
tasks to nodes with larger capacity, which can balance the load distribution among all nodes.

This message was sent by Atlassian JIRA

View raw message