hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3717) Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API
Date Wed, 09 Sep 2015 22:38:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737733#comment-14737733
] 

Wangda Tan commented on YARN-3717:
----------------------------------

bq.  Hope we could follow the same approach for node labels too. As it would be easy to analyze.
If not other option is to indicate if app label is null, then in the web ui( also rest? )
show as <Queue's Default Node Label>. Also for AM as <Application Node Label's Expression>
I didn't do this because I want late-binding, when queue's default-node-label-expression updated,
new resource requests sent after the updating will be updated as well. So I prefer to keep
it as-is, and improve this in the future. (For example, showing queue's label when the app's
label doesn't set, etc.)

bq. If not other option is to indicate if app label is null, then in the web ui( also rest?
) show as <Queue's Default Node Label>. Also for AM as <Application Node Label's
Expression>
I've thought about this also, it's not straight forward to me as well, user has to look at
other configurations, it's not a big improvement comparing to show "<not-set>".

bq. Sure, it makes sense but what abt REST ? need to follow the same right ?
I prefere to keep REST API as-is, <DEFAULT_PARTITION> is just an alias of the "", we
can easily update web UI to different aliases.

bq.  but should we not support additional CLI similar to the lines of UI to get the Queue
stats based on NodeLabel?
It will be very helpful, but if we want to do this, do we need to update REST API as well?
Now it doesn't support get "ResourceUsage". I think we need it in both REST API (for YARN-3368)
/ CLI.
Also we need to return ResourceUsage for app as well, which could be done in a separated JIRA.

> Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API
> -------------------------------------------------------------------------
>
>                 Key: YARN-3717
>                 URL: https://issues.apache.org/jira/browse/YARN-3717
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Naganarasimha G R
>            Assignee: Naganarasimha G R
>         Attachments: 3717_cluster_test_snapshots.zip, RMLogsForHungJob.log, YARN-3717.20150822-1.patch,
YARN-3717.20150824-1.patch, YARN-3717.20150825-1.patch, YARN-3717.20150826-1.patch
>
>
> 1> Add the default-node-Label expression for each queue in scheduler page.
> 2> In Application/Appattempt page  show the app configured node label expression for
AM and Job



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message