hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)
Date Wed, 22 Oct 2014 01:54:35 GMT

     [ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Naganarasimha G R updated YARN-2495:
------------------------------------
    Attachment: YARN-2495_20141022.1.patch

Hi All,
Uploading a WIP patch, just to share the approach...
Completed 
* User can set labels in each NM (by setting yarn-site.xml or using script suggested by Allen
Wittenauer)
* NM will send labels to RM via ResourceTracker API
* RM will set labels in NodeLabelManager when NM register/update labels

Pending :
* No test cases written. and may be test cases modified to resolve compilation issues can
be done in a better way.
* As per the design Doc there was requirement to specifically either support distributed or
Centralized but was not sure how to get it done as current design does not seem to be specific
to central or distributed and  class was configured to identify NodeLabelsManager, 
* Currently i have not completely ensured that Node Labels are sent only when there is change
in the labels got from script to the last successful updated labels to RM. Response of node
heartbeat and node register can be made used for this. Yet to finish.
* Configuration has been added to validate for centralized labels. But need to further discuss
on the approach for this.

> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
>         Attachments: YARN-2495_20141022.1.patch
>
>
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script suggested
by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message