hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jian Fang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests
Date Tue, 27 May 2014 16:56:02 GMT

    [ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14009893#comment-14009893

Jian Fang commented on YARN-796:

Hi Bikas, I think it is better to have the node manager to specify its own labels and then
it registers the labels with RM. 

Also, it would be great if YARN could provide an API to add/update labels to a node. This
is based on the following scenario.

Usually a hadoop cluster in cloud is elastic, that is to say, the cluster size can be automatically
or manually expended or shrunk based on cluster situation, for example, idleness.  When a
node in a cluster is chosen to be shrunk, i.e., to be removed, we could call the API to label
the node so that no more tasks would be assigned to this node.  

We could use the decommission API to achieve this goal, but I think the label API may be more

> Allow for (admin) labels on nodes and resource-requests
> -------------------------------------------------------
>                 Key: YARN-796
>                 URL: https://issues.apache.org/jira/browse/YARN-796
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Arun C Murthy
>            Assignee: Wangda Tan
>         Attachments: YARN-796.patch
> It will be useful for admins to specify labels for nodes. Examples of labels are OS,
processor architecture etc.
> We should expose these labels and allow applications to specify labels on resource-requests.
> Obviously we need to support admin operations on adding/removing node labels.

This message was sent by Atlassian JIRA

View raw message