hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szilard Nemeth (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section
Date Fri, 12 Jan 2018 13:12:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323935#comment-16323935
] 

Szilard Nemeth edited comment on YARN-7451 at 1/12/18 1:11 PM:
---------------------------------------------------------------

Thanks [~grepas] for your comments.
All of them are fixed except org.apache.hadoop.yarn.server.resourcemanager.webapp.representationhelper.path.ArrayElementPathSegment#extractIndex
since it is already "handled".
See the line "return Integer.parseInt(matcher.group(1));" ,
the matcher group call would throw an IllegalStateException which is perfectly reasonable
in tests I suppose.
Also fixed a bunch of checkstyle warnings.


was (Author: snemeth):
Thanks [~grepas] for your comments.
All of them are fixed except org.apache.hadoop.yarn.server.resourcemanager.webapp.representationhelper.path.ArrayElementPathSegment#extractIndex
since it is already "handled".
in the line "return Integer.parseInt(matcher.group(1));" the matcher group call would throw
an IllegalStateException which is perfectly reasonable in tests I think.
Also fixed a bunch of checkstyle warnings.

> Resources Types should be visible in the Cluster Apps API "resourceRequests" section
> ------------------------------------------------------------------------------------
>
>                 Key: YARN-7451
>                 URL: https://issues.apache.org/jira/browse/YARN-7451
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager, restapi
>    Affects Versions: 3.0.0
>            Reporter: Grant Sohn
>            Assignee: Szilard Nemeth
>         Attachments: YARN-7451.001.patch, YARN-7451.002.patch, YARN-7451.003.patch, YARN-7451.004.patch,
YARN-7451.005.patch, YARN-7451.006.patch, YARN-7451__Expose_custom_resource_types_on_RM_scheduler_API_as_flattened_map01_02.patch
>
>
> When running jobs that request resource types the RM Cluster Apps API should include
this in the "resourceRequests" object.
> Additionally, when calling the RM scheduler API it returns:
> {noformat}
>  "childQueues": {
>                                 "queue": [
>                                     {
>                                         "allocatedContainers": 101,
>                                         "amMaxResources": {
>                                             "memory": 320390,
>                                             "vCores": 192
>                                         },
>                                         "amUsedResources": {
>                                             "memory": 1024,
>                                             "vCores": 1
>                                         },
>                                         "clusterResources": {
>                                             "memory": 640779,
>                                             "vCores": 384
>                                         },
>                                         "demandResources": {
>                                             "memory": 103424,
>                                             "vCores": 101
>                                         },
>                                         "fairResources": {
>                                             "memory": 640779,
>                                             "vCores": 384
>                                         },
>                                         "maxApps": 2147483647,
>                                         "maxResources": {
>                                             "memory": 640779,
>                                             "vCores": 384
>                                         },
>                                         "minResources": {
>                                             "memory": 0,
>                                             "vCores": 0
>                                         },
>                                         "numActiveApps": 1,
>                                         "numPendingApps": 0,
>                                         "preemptable": true,
>                                         "queueName": "root.users.systest",
>                                         "reservedContainers": 0,
>                                         "reservedResources": {
>                                             "memory": 0,
>                                             "vCores": 0
>                                         },
>                                         "schedulingPolicy": "fair",
>                                         "steadyFairResources": {
>                                             "memory": 320390,
>                                             "vCores": 192
>                                         },
>                                         "type": "fairSchedulerLeafQueueInfo",
>                                         "usedResources": {
>                                             "memory": 103424,
>                                             "vCores": 101
>                                         }
>                                     }
>                                 ]
> {noformat}
> However, the web UI shows resource types usage.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message