hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy
Date Tue, 21 Apr 2015 18:18:59 GMT

    [ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505421#comment-14505421

Hadoop QA commented on YARN-3319:

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  against trunk revision 8ddbb8d.

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 2 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 1 new Findbugs (version
2.0.3) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.

Test results: https://builds.apache.org/job/PreCommit-YARN-Build/7426//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-YARN-Build/7426//artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-resourcemanager.html
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7426//console

This message is automatically generated.

> Implement a FairOrderingPolicy
> ------------------------------
>                 Key: YARN-3319
>                 URL: https://issues.apache.org/jira/browse/YARN-3319
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: scheduler
>            Reporter: Craig Welch
>            Assignee: Craig Welch
>         Attachments: YARN-3319.13.patch, YARN-3319.14.patch, YARN-3319.17.patch, YARN-3319.35.patch,
YARN-3319.39.patch, YARN-3319.45.patch, YARN-3319.47.patch, YARN-3319.53.patch, YARN-3319.58.patch,
YARN-3319.70.patch, YARN-3319.71.patch, YARN-3319.72.patch, YARN-3319.73.patch
> Implement a FairOrderingPolicy which prefers to allocate to SchedulerProcesses with least
current usage, very similar to the FairScheduler's FairSharePolicy.  
> The Policy will offer allocations to applications in a queue in order of least resources
used, and preempt applications in reverse order (from most resources used). This will include
conditional support for sizeBasedWeight style adjustment
> Optionally, based on a conditional configuration to enable sizeBasedWeight (default false),
an adjustment to boost larger applications (to offset the natural preference for smaller applications)
will adjust the resource usage value based on demand, dividing it by the below value:
> Math.log1p(app memory demand) / Math.log(2);
> In cases where the above is indeterminate (two applications are equal after this comparison),
behavior falls back to comparison based on the application id, which is generally lexically
FIFO for that comparison

This message was sent by Atlassian JIRA

View raw message