hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-8443) Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers
Date Mon, 25 Jun 2018 01:51:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16521763#comment-16521763
] 

Hudson commented on YARN-8443:
------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14472 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14472/])
YARN-8443. Total #VCores in cluster metrics is wrong when (wwei: rev 440140cea6718229094a3d2b97b9b9bd28b95d9b)
* (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/ClusterMetricsInfo.java


> Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers
> -----------------------------------------------------------------------------------------
>
>                 Key: YARN-8443
>                 URL: https://issues.apache.org/jira/browse/YARN-8443
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: webapp
>    Affects Versions: 2.9.0, 3.1.0, 3.2.0
>            Reporter: Tao Yang
>            Assignee: Tao Yang
>            Priority: Major
>             Fix For: 3.2.0, 3.1.1, 3.0.4
>
>         Attachments: YARN-8443.001.patch
>
>
> Cluster metrics on the web UI will give wrong Total Vcores when there is reserved
container for CapacityScheduler.
>  Reference code:
> {code:java|title=ClusterMetricsInfo.java}
>     if (rs instanceof CapacityScheduler) {
>       CapacityScheduler cs = (CapacityScheduler) rs;
>       this.totalMB = availableMB + allocatedMB + reservedMB;
>       this.totalVirtualCores =
>           availableVirtualCores + allocatedVirtualCores + containersReserved;
>        ...
>     }
> {code}
> The key of this problem is the calculation of totalVirtualCores, {{containersReserved}}
is the number of reserved containers, not reserved VCores. The correct calculation expression
of totalVirtualCores should be (availableVirtualCores + allocatedVirtualCores + reservedVirtualCores)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message