hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yufei Gu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6636) Fair Scheduler: respect node labels at resource request level
Date Tue, 07 Aug 2018 20:43:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16572303#comment-16572303
] 

Yufei Gu commented on YARN-6636:
--------------------------------

There are multiple ways to approach node labeling in Fair Scheduler. The community doesn't
have the consensus. The way YARN-2497 took heavily involves queue management or fair share
calculations.  Whether node labeling want to affect queue management  is decided by whether
we want fairness on the node labeling. Node labeling partitions the cluster resources. My
take is we generally still need fairness on each partition, which is materialized by queue,
fair share. However, some particular cases only require node labeling to act like data locality
which doesn't need fairness.

> Fair Scheduler: respect node labels at resource request level
> -------------------------------------------------------------
>
>                 Key: YARN-6636
>                 URL: https://issues.apache.org/jira/browse/YARN-6636
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: fairscheduler
>            Reporter: Ashwin Shankar
>            Assignee: Ashwin Shankar
>            Priority: Major
>
> This ticket is to track changes to fair scheduler to respect node labels at resource
request level. When the client sets labels at resource request level, the scheduler must schedule
those containers only on those nodes with that label. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message