hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)
Date Tue, 14 Oct 2014 12:36:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14170860#comment-14170860

Sunil G commented on YARN-2495:

Hi All.

I have a doubt here, 

1. In distributed configuration, each NM can specify label in register/heartbeat(update).
I am not sure check for "Valid Label" to happen in RM or NM. As per the current design, it
looks like all valid checks are happening at RM. 
If any such node label is invalid as per RM, then how this will be reported back to NM? Error

2. If possible to change label at run time from NM, i think same existing interfaces are used
(heartbeat). Do you feel this check will happen may be more frequent in RM than in a Centralized
configuration? In centralized config, some command will be fired by admin to change labels.
This may not be frequent. But imagine a 1000 node cluster, and then with changing labels per
heartbeat, will this be a bottleneck?

> Allow admin specify labels in each NM (Distributed configuration)
> -----------------------------------------------------------------
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml or using script suggested
by [~aw])
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels

This message was sent by Atlassian JIRA

View raw message