hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil Govindan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers
Date Fri, 02 Nov 2018 11:23:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672961#comment-16672961

Sunil Govindan commented on YARN-8948:

On this note, this is not an interface level compatibility problem.

Ideally we should have done for all schedulers, however this is not affecting the interface,
and hence i suggest to mark this as Major and get this in all respective versions and next
release can take this.

If you feel this is really a blocker to 3.2, kindly let me know.

> PlacementRule interface should be for all YarnSchedulers
> --------------------------------------------------------
>                 Key: YARN-8948
>                 URL: https://issues.apache.org/jira/browse/YARN-8948
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>            Priority: Critical
>         Attachments: YARN-8948.001.patch, YARN-8948.002.patch, YARN-8948.003.patch
> *Issue 1:*
> YARN-3635 intention was to add PlacementRule interface common for all YarnSchedules.
> {code}
> 33	  public abstract boolean initialize(
> 34	      CapacitySchedulerContext schedulerContext) throws IOException;
> {code}
> PlacementRule initialization is done using CapacitySchedulerContext binding to CapacityScheduler
> *Issue 2:*
> {{yarn.scheduler.queue-placement-rules}} doesn't work as expected in Capacity Scheduler
> {quote}
> * **Queue Mapping Interface based on Default or User Defined Placement Rules** - This
feature allows users to map a job to a specific queue based on some default placement rule.
For instance based on user & group, or application name. User can also define their own
placement rule.
> {quote}
> As per current UserGroupMapping is always added in placementRule. {{CapacityScheduler#updatePlacementRules}}
> {code}
>     // Initialize placement rules
>     Collection<String> placementRuleStrs = conf.getStringCollection(
>         YarnConfiguration.QUEUE_PLACEMENT_RULES);
>     List<PlacementRule> placementRules = new ArrayList<>();
> ...
>     // add UserGroupMappingPlacementRule if absent
>     distingushRuleSet.add(YarnConfiguration.USER_GROUP_PLACEMENT_RULE);
> {code}
> PlacementRule configuration order is not maintained 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message