hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Payne (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI
Date Wed, 30 Mar 2016 17:10:25 GMT

    [ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218335#comment-15218335

Eric Payne commented on YARN-4751:

[~leftnoteasy] / [~sunilg]:

YARN-3362 (Add node label usage in RM CapacityScheduler web UI) is dependent upon parts of
both YARN-3361 (CapacityScheduler side changes to support non-exclusive node labels) and YARN-4162
(CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST
API). In turn, YARN-3361 is dependent on YARN-3356 (Capacity Scheduler FiCaSchedulerApp should
use ResourceUsage to track used-resources-by-label.).

The dependencies are as follows:
- YARN-3362 depends on YARN-3361 for the new method {{AbstractCSQueue#accessibleToPartition}}
- YARN-3362 depends on YARN-4162 for addition of the {{CapacityScheduler}} parameter to {{CapacitySchedulerInfo}}
- YARN-3361 depends on YARN-3356 for the modifications to {{LeafQueue#canAssignToUser}}

I am not comfortable with pulling all of these changes back into 2.7, especially the changes
for non-exclusive node labels. I fear that there is a risk of destabilization. It may be possible
to rewrite YARN-3362 so that it is not dependent on those other patches, but that seems like
it could also be a risk and a lot of time spent for the purpose of getting the GUI metrics

Please let me know what approach you would like to take. If the current patch is not an option,
then we can close this JIRA as won'tfix.

> In 2.7, Labeled queue usage not shown properly in capacity scheduler UI
> -----------------------------------------------------------------------
>                 Key: YARN-4751
>                 URL: https://issues.apache.org/jira/browse/YARN-4751
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler, yarn
>    Affects Versions: 2.7.3
>            Reporter: Eric Payne
>            Assignee: Eric Payne
>         Attachments: 2.7 CS UI No BarGraph.jpg, YARH-4752-branch-2.7.001.patch, YARH-4752-branch-2.7.002.patch
> In 2.6 and 2.7, the capacity scheduler UI does not have the queue graphs separated by
partition. When applications are running on a labeled queue, no color is shown in the bar
graph, and several of the "Used" metrics are zero.

This message was sent by Atlassian JIRA

View raw message