hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-326) Add multi-resource scheduling to the fair scheduler
Date Mon, 04 Feb 2013 20:22:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13570591#comment-13570591
] 

Eli Collins commented on YARN-326:
----------------------------------

Hey Sandy,

Please post a PDF of the doc or some text format so we can track changes in this jira. Eg
upload a new doc with each rev.

Wrt your definition of dominant share, we want to implement weighted DRF here, and per section
4.3 in the paper:

{noformat}The definition of a dominant share for user i changes to
s_i = max_j{ u_i,j / w_i,j }
where u_i,j is user i’s share of resource j{noformat}
                
> Add multi-resource scheduling to the fair scheduler
> ---------------------------------------------------
>
>                 Key: YARN-326
>                 URL: https://issues.apache.org/jira/browse/YARN-326
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: scheduler
>    Affects Versions: 2.0.2-alpha
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>
> With YARN-2 in, the capacity scheduler has the ability to schedule based on multiple
resources, using dominant resource fairness.  The fair scheduler should be able to do multiple
resource scheduling as well, also using dominant resource fairness.
> More details to come on how the corner cases with fair scheduler configs such as min
and max resources will be handled.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message