hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2728) Support for disabling the Centralized NodeLabel validation in Distributed Node Label Configuration setup
Date Wed, 03 Dec 2014 17:43:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233233#comment-14233233
] 

Naganarasimha G R commented on YARN-2728:
-----------------------------------------

Hi [~wangda],
In the leiu of earlier review [comment1|https://issues.apache.org/jira/browse/YARN-2495?focusedCommentId=14169984&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14169984]
& [comment2|https://issues.apache.org/jira/browse/YARN-2495?focusedCommentId=14169984&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14169984]
in Yarn-2495, 
{quote}
 Now if user want to leverage change of capacity scheduler, user MUST specify 1) labels can
be accessed by the queue and 2) proportion of resource can be accessed by a queue of each
label.
Back to the central node label validation discussion, without this, we cannot get capacity
scheduler work for now. (user cannot specify capacity for a unknown node-label for a queue,
etc.). 
{quote}
I feel we can keep the design same and we can have a configuration flag based on which we
can decide to do the following
# Disable(/throw exception) in CommonNodeLabelsManager.addToCluserNodeLabels & removeFromClusterNodeLabels
(so that Cluster Node labels are not taken from REST or CLI)
# Support protected method in CommonNodeLabelsManager which updates the label mgr with new
labels(as cluster node labels) and invoke it from CommonNodeLabelsManager.addLabelsToNode


By doing this, we will have the flexibility to enable or disable this centralized valid cluster
node labels functionality in both centralized and distributed Node Labels configuration.

> Support for disabling the Centralized NodeLabel validation in Distributed Node Label
Configuration setup
> --------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2728
>                 URL: https://issues.apache.org/jira/browse/YARN-2728
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager, resourcemanager
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>
> Currently without Central List of Valid Labels, Capacity scheduler will not be able to
work (user cannot specify capacity for a unknown node-label for a queue, etc.). But without
disabling the central label validation, Distributed Node Label configuration  feature is not
complete. so we need to support this feature



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message