hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler
Date Wed, 13 Nov 2013 22:55:22 GMT

    [ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821950#comment-13821950

Alejandro Abdelnur commented on YARN-1392:

a few final minor things:

* documentation, we should explicitly state that if the specified queue is 'default' it is
handled as if no queue has been specified. This behavior is to provide backwards compatibility
with how Map-Reduce handles queue setting.

* FairScheduler.java, the original logic to map a user to queue if no placement policy is
defined seems it could be modeled as a default placement policy rule(s). Then queue resolution
is always done by the queue manager. there is a false change (trimming empty line in line
715 after patch)

* QueuePlacementPolicy.java, 'primarygroup' rule should be 'primaryGroup' for consistency
(update doc as well)

> Allow sophisticated app-to-queue placement policies in the Fair Scheduler
> -------------------------------------------------------------------------
>                 Key: YARN-1392
>                 URL: https://issues.apache.org/jira/browse/YARN-1392
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: scheduler
>    Affects Versions: 2.2.0
>            Reporter: Sandy Ryza
>            Assignee: Sandy Ryza
>         Attachments: YARN-1392-1.patch, YARN-1392-1.patch, YARN-1392-2.patch, YARN-1392.patch
> Currently the Fair Scheduler supports app-to-queue placement by username.  It would be
beneficial to allow more sophisticated policies that rely on primary and secondary groups
and fallbacks.

This message was sent by Atlassian JIRA

View raw message