hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3093) Support load command from admin [Helps to load big set of labels]
Date Sat, 24 Jan 2015 01:21:34 GMT

    [ https://issues.apache.org/jira/browse/YARN-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290324#comment-14290324

Wangda Tan commented on YARN-3093:

That will be helpful, +1 for the propose too!.

I think we can make it compatible with syntax in YARN-3028, and in addition, do you think
is it possible we can add labels appeared in the conf file to clusterNodeLabels automatically?
Which we can make the config file simpler.

> Support load command from admin [Helps to load big set of labels]
> -----------------------------------------------------------------
>                 Key: YARN-3093
>                 URL: https://issues.apache.org/jira/browse/YARN-3093
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>    Affects Versions: 2.6.0
>            Reporter: Sunil G
>            Assignee: Sunil G
> Proposing "yarn rmadmin -load -nodelabels <filename>"
> "nodelabels" can be one such option here, and this can be generalized by giving other
options later.
> Advantage of this command will be an easier configuration. Assume admin need to load
labels to more than 20+ nodes, current command is little difficult. If these config can be
preloaded in a file, and then can upload to RM. With existing parsing and update logic, same
can be achieved.
> I am showing a simpler proposed config file.
> {noformat}
> rm1 $ cat node_label.conf
> add [
> label1,label2,label3,label4,label11,label12,label13,label14,abel21,label22,label23,label24
> ]  
> replace[
> node1:port=label1,label2,label23,label24
> node2:port=label4,abel11,label12,label13,label14,label21
> node3:port=label2,label3,label4,label11,label12,label13,label14
> node4:port=label14,label21,label22,label23,label24
> node5:port=label14,label21,label22,label23,label24
> node6:port=label4,label11,label12,label13,label14,label21,label22,label23,label24
> ]
> {noformat}
> A restriction on file size can be kept to avoid uploading very huge files. 
> Please share your opinion.

This message was sent by Atlassian JIRA

View raw message