hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)
Date Mon, 13 Oct 2014 12:05:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169211#comment-14169211

Naganarasimha G R commented on YARN-2495:

hi [~wangda] & [~aw] ,
Few queries :
Some Requirements which make more sense for Centralized Configuration and not for Distributed
	* ADD_LABELS (add valid labels which can be assigned to nodes of cluster)
	* REMOVE_LABELS (Remove from valid labels of cluster)

As by configuration in yarnsite or dynamic scripting we are setting the labels for each Node,
My opinion is to not support for distributed configuration for above cluster labels.
But If we require to support this 
	* as the valid lables information is only available with the RM, after the node sends heartbeat
RM retains only valid labels for that node( log if any invalid labels) or we can just ignore
all the labels for that node if invalid labels exists
	* We need to store the valid cluster node lables in the file but need not store labels for
cluster nodes as during every registration nodes label can be got.

> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script suggested
by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels

This message was sent by Atlassian JIRA

View raw message