hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Szilard Nemeth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section
Date Tue, 02 Jan 2018 15:22:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Szilard Nemeth updated YARN-7451:
---------------------------------
    Description: 
When running jobs that request resource types the RM Cluster Apps API should include this
in the "resourceRequests" object.

Additionally, when calling the RM scheduler API it returns:
{noformat}
 "childQueues": {
                                "queue": [
                                    {
                                        "allocatedContainers": 101,
                                        "amMaxResources": {
                                            "memory": 320390,
                                            "vCores": 192
                                        },
                                        "amUsedResources": {
                                            "memory": 1024,
                                            "vCores": 1
                                        },
                                        "clusterResources": {
                                            "memory": 640779,
                                            "vCores": 384
                                        },
                                        "demandResources": {
                                            "memory": 103424,
                                            "vCores": 101
                                        },
                                        "fairResources": {
                                            "memory": 640779,
                                            "vCores": 384
                                        },
                                        "maxApps": 2147483647,
                                        "maxResources": {
                                            "memory": 640779,
                                            "vCores": 384
                                        },
                                        "minResources": {
                                            "memory": 0,
                                            "vCores": 0
                                        },
                                        "numActiveApps": 1,
                                        "numPendingApps": 0,
                                        "preemptable": true,
                                        "queueName": "root.users.systest",
                                        "reservedContainers": 0,
                                        "reservedResources": {
                                            "memory": 0,
                                            "vCores": 0
                                        },
                                        "schedulingPolicy": "fair",
                                        "steadyFairResources": {
                                            "memory": 320390,
                                            "vCores": 192
                                        },
                                        "type": "fairSchedulerLeafQueueInfo",
                                        "usedResources": {
                                            "memory": 103424,
                                            "vCores": 101
                                        }
                                    }
                                ]
{noformat}

However, the web UI shows resource types usage.


  was:
When running jobs that request resource types the RM Cluster Apps API should include this
in the "resourceRequests" object.

Additionally, when calling the RM scheduler API it returns:
{noformat}
 "childQueues": {
                                "queue": [
                                    {
                                        "allocatedContainers": 101,
                                        "amMaxResources": {
                                            "memory": 320390,
                                            "vCores": 192
                                        },
                                        "amUsedResources": {
                                            "memory": 1024,
                                            "vCores": 1
                                        },
                                        "clusterResources": {
                                            "memory": 640779,
                                            "vCores": 384
                                        },
                                        "demandResources": {
                                            "memory": 103424,
                                            "vCores": 101
                                        },
                                        "fairResources": {
                                            "memory": 640779,
                                            "vCores": 384
                                        },
                                        "maxApps": 2147483647,
                                        "maxResources": {
                                            "memory": 640779,
                                            "vCores": 384
                                        },
                                        "minResources": {
                                            "memory": 0,
                                            "vCores": 0
                                        },
                                        "numActiveApps": 1,
                                        "numPendingApps": 0,
                                        "preemptable": true,
                                        "queueName": "root.users.systest",
                                        "reservedContainers": 0,
                                        "reservedResources": {
                                            "memory": 0,
                                            "vCores": 0
                                        },
                                        "schedulingPolicy": "fair",
                                        "steadyFairResources": {
                                            "memory": 320390,
                                            "vCores": 192
                                        },
                                        "type": "fairSchedulerLeafQueueInfo",
                                        "usedResources": {
                                            "memory": 103424,
                                            "vCores": 101
                                        }
                                    }
                                ]
{noformat}

However, the web UI shows resource types usage.  (See screenshot)



> Resources Types should be visible in the Cluster Apps API "resourceRequests" section
> ------------------------------------------------------------------------------------
>
>                 Key: YARN-7451
>                 URL: https://issues.apache.org/jira/browse/YARN-7451
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager, restapi
>    Affects Versions: 3.0.0
>            Reporter: Grant Sohn
>            Assignee: Szilard Nemeth
>
> When running jobs that request resource types the RM Cluster Apps API should include
this in the "resourceRequests" object.
> Additionally, when calling the RM scheduler API it returns:
> {noformat}
>  "childQueues": {
>                                 "queue": [
>                                     {
>                                         "allocatedContainers": 101,
>                                         "amMaxResources": {
>                                             "memory": 320390,
>                                             "vCores": 192
>                                         },
>                                         "amUsedResources": {
>                                             "memory": 1024,
>                                             "vCores": 1
>                                         },
>                                         "clusterResources": {
>                                             "memory": 640779,
>                                             "vCores": 384
>                                         },
>                                         "demandResources": {
>                                             "memory": 103424,
>                                             "vCores": 101
>                                         },
>                                         "fairResources": {
>                                             "memory": 640779,
>                                             "vCores": 384
>                                         },
>                                         "maxApps": 2147483647,
>                                         "maxResources": {
>                                             "memory": 640779,
>                                             "vCores": 384
>                                         },
>                                         "minResources": {
>                                             "memory": 0,
>                                             "vCores": 0
>                                         },
>                                         "numActiveApps": 1,
>                                         "numPendingApps": 0,
>                                         "preemptable": true,
>                                         "queueName": "root.users.systest",
>                                         "reservedContainers": 0,
>                                         "reservedResources": {
>                                             "memory": 0,
>                                             "vCores": 0
>                                         },
>                                         "schedulingPolicy": "fair",
>                                         "steadyFairResources": {
>                                             "memory": 320390,
>                                             "vCores": 192
>                                         },
>                                         "type": "fairSchedulerLeafQueueInfo",
>                                         "usedResources": {
>                                             "memory": 103424,
>                                             "vCores": 101
>                                         }
>                                     }
>                                 ]
> {noformat}
> However, the web UI shows resource types usage.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message