hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)
Date Thu, 11 Dec 2014 21:56:14 GMT

    [ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243217#comment-14243217

Allen Wittenauer commented on YARN-2495:

bq.  This can already be accomplished using the admin cli from a script or calling a web service
from the node

Think about the secure cluster case. A whole new level of complexity is required to get this
functionality using your proposed method vs. having the NM just run the script itself.

bq.  Is this all just to support putting labels into the node-managers configuration file
and introducing them that way? Do we have a solid need for that? 

No, this is so we *don't* have to have hard-coded labels in a file.  If we are doing an external
software change, we need to be able to reflect that change up the chain.  Think rolling upgrade.
 Think multiple service owners. 

FWIW, yes, we do have a solid need for this feature.  Almost every ops person I talked to
has said they'd likely make use it for the exact use cases I've highlighted above. Being able
to roll out new versions of Java and make scheduling decisions on its installation is *extremely*
powerful and useful.

> Allow admin specify labels from each NM (Distributed configuration)
> -------------------------------------------------------------------
>                 Key: YARN-2495
>                 URL: https://issues.apache.org/jira/browse/YARN-2495
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Naganarasimha G R
>         Attachments: YARN-2495.20141023-1.patch, YARN-2495.20141024-1.patch, YARN-2495.20141030-1.patch,
YARN-2495.20141031-1.patch, YARN-2495.20141119-1.patch, YARN-2495.20141126-1.patch, YARN-2495.20141204-1.patch,
YARN-2495.20141208-1.patch, YARN-2495_20141022.1.patch
> Target of this JIRA is to allow admin specify labels in each NM, this covers
> - User can set labels in each NM (by setting yarn-site.xml (YARN-2923) or using script
suggested by [~aw] (YARN-2729) )
> - NM will send labels to RM via ResourceTracker API
> - RM will set labels in NodeLabelManager when NM register/update labels

This message was sent by Atlassian JIRA

View raw message