hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection
Date Tue, 04 Nov 2014 21:28:36 GMT

    [ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14196853#comment-14196853

Allen Wittenauer commented on YARN-2786:

bq. like a node doesn't know "I should run hbase, I should run storm, etc.". Basically script
method can only get basic attribute of the node.

What is the difference between a user running a command that adds an hbase attribute to a
node, the configuration file listing the hbase attribute to a node, the configuration on the
node manager that says it has the hbase attribute, and the dynamic script telling the NM has
the hbase attribute?

The biggest problem I see with having a more public API way of adding attributes is that this
means we need to keep state and all the management of that state... even between restarts.
 This just isn't viable long term without a lot of heavy lifting.

bq. yarn cluster

This is *exactly* why I wanted an analog of dfsadmin -report.  This is a user consistency
issue.  The rmadmin -report should list all the nodes as well as what their node labels are
(amongst other interesting things).

So, no on yarn cluster as well.  

> Create yarn cluster CLI to enable list node labels collection
> -------------------------------------------------------------
>                 Key: YARN-2786
>                 URL: https://issues.apache.org/jira/browse/YARN-2786
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: api, client, resourcemanager
>            Reporter: Wangda Tan
>            Assignee: Wangda Tan
>         Attachments: YARN-2786-20141031-1.patch, YARN-2786-20141031-2.patch, YARN-2786-20141102-2.patch,
YARN-2786-20141102-3.patch, YARN-2786-20141103-1-full.patch, YARN-2786-20141103-1-without-yarn.cmd.patch,
YARN-2786-20141104-1-full.patch, YARN-2786-20141104-1-without-yarn.cmd.patch
> With YARN-2778, we can list node labels on existing RM nodes. But it is not enough, we
should be able to: 
> 1) list node labels collection
> The command should start with "yarn cluster ...", in the future, we can add more functionality
to the "yarnClusterCLI"

This message was sent by Atlassian JIRA

View raw message