hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests
Date Mon, 07 Jul 2014 14:32:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053704#comment-14053704
] 

Allen Wittenauer commented on YARN-796:
---------------------------------------

b

bq. Instead, each node can supply its own labels, via yarn.nodemanager.node.labels (which
specifies labels directly) or yarn.nodemanager.node.labelFile (which points to a file that
has a single line containing all the labels). It's easy to generate the label file for each
node. 

Why not just generate this on the node manager a la health check or topology?  Provide a hook
to actually execute the script or the class and have the NM run it by a user-defined period,
including "just at a boot".  [... and before it gets asked, yes, certain classes of hardware
*do* allow such dynamic change.]

> Allow for (admin) labels on nodes and resource-requests
> -------------------------------------------------------
>
>                 Key: YARN-796
>                 URL: https://issues.apache.org/jira/browse/YARN-796
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Arun C Murthy
>            Assignee: Wangda Tan
>         Attachments: LabelBasedScheduling.pdf, YARN-796.patch
>
>
> It will be useful for admins to specify labels for nodes. Examples of labels are OS,
processor architecture etc.
> We should expose these labels and allow applications to specify labels on resource-requests.
> Obviously we need to support admin operations on adding/removing node labels.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message