hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szilard Nemeth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-9322) Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo
Date Thu, 21 Feb 2019 11:08:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Szilard Nemeth updated YARN-9322:
---------------------------------
    Description: 
YARN-8842 implemented storing and exposing of metrics of custom resources.
FSQueueMetrics should have a similar implementation.
All metrics stored in this class should have their custom resource counterpart.

In a consequence of metrics were not stored for custom resource type, FairSchedulerQueueInfo
haven't contained those values therefore the UI v1 could not show them, obviously. 
See that gpu is missing from the value of  "AM Max Resources" on the attached screenshot.

Additionally, the callees of the following methods (in class FairSchedulerQueueInfo) should
consider to query values for custom resource types too: 
getMaxAMShareMB
getMaxAMShareVCores
getAMResourceUsageMB
getAMResourceUsageVCores

  was:
YARN-8842 implemented storing and exposing of metrics of custom resources.
FSQueueMetrics should have a similar implementation.
All metrics stored in this class should have their custom resource counterpart.

In a consequence of metrics were not stored for custom resource type, FairSchedulerQueueInfo
haven't contained those values therefore the UI v1 could not show them, obviously.

Additionally, the callees of the following methods (in class FairSchedulerQueueInfo) should
consider to query values for custom resource types too: 
getMaxAMShareMB
getMaxAMShareVCores
getAMResourceUsageMB
getAMResourceUsageVCores


> Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo
> ----------------------------------------------------------------------------------------------------
>
>                 Key: YARN-9322
>                 URL: https://issues.apache.org/jira/browse/YARN-9322
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Szilard Nemeth
>            Assignee: Szilard Nemeth
>            Priority: Major
>         Attachments: Screen Shot 2019-02-21 at 12.06.46.png
>
>
> YARN-8842 implemented storing and exposing of metrics of custom resources.
> FSQueueMetrics should have a similar implementation.
> All metrics stored in this class should have their custom resource counterpart.
> In a consequence of metrics were not stored for custom resource type, FairSchedulerQueueInfo
haven't contained those values therefore the UI v1 could not show them, obviously. 
> See that gpu is missing from the value of  "AM Max Resources" on the attached screenshot.
> Additionally, the callees of the following methods (in class FairSchedulerQueueInfo)
should consider to query values for custom resource types too: 
> getMaxAMShareMB
> getMaxAMShareVCores
> getAMResourceUsageMB
> getAMResourceUsageVCores



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message