hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nikhil Mulley (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2408) Resource Request REST API for YARN
Date Thu, 23 Apr 2015 07:24:40 GMT

    [ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508586#comment-14508586
] 

Nikhil Mulley commented on YARN-2408:
-------------------------------------

Hi [~rdelvalle]

There are 8 people voting for it and 15 people watching this issue. I am not sure what is
the requirement in the community for having a general interest though but I would be happy
to help this move forward in terms of having the patch deployed on my test cluster and give
it a whirl and see where it goes.

I am as well interested in the rest api to provide means to monitor the cluster resources,
in general, to have a means to monitor the slow/starving jobs and the resources requested/consumed
per app/job via rest api.

Nikhil

> Resource Request REST API for YARN
> ----------------------------------
>
>                 Key: YARN-2408
>                 URL: https://issues.apache.org/jira/browse/YARN-2408
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: webapp
>            Reporter: Renan DelValle
>              Labels: features
>
> I’m proposing a new REST API for YARN which exposes a snapshot of the Resource Requests
that exist inside of the Scheduler. My motivation behind this new feature is to allow external
software to monitor the amount of resources being requested to gain more insightful information
into cluster usage than is already provided. The API can also be used by external software
to detect a starved application and alert the appropriate users and/or sys admin so that the
problem may be remedied.
> Here is the proposed API (a JSON counterpart is also available):
> {code:xml}
> <resourceRequests>
>   <MB>7680</MB>
>   <VCores>7</VCores>
>   <appMaster>
>     <applicationId>application_1412191664217_0001</applicationId>
>     <applicationAttemptId>appattempt_1412191664217_0001_000001</applicationAttemptId>
>     <queueName>default</queueName>
>     <totalMB>6144</totalMB>
>     <totalVCores>6</totalVCores>
>     <numResourceRequests>3</numResourceRequests>
>     <requests>
>       <request>
>         <MB>1024</MB>
>         <VCores>1</VCores>
>         <numContainers>6</numContainers>
>         <relaxLocality>true</relaxLocality>
>         <priority>20</priority>
>         <resourceNames>
>           <resourceName>localMachine</resourceName>
>           <resourceName>/default-rack</resourceName>
>           <resourceName>*</resourceName>
>         </resourceNames>
>       </request>
>     </requests>
>   </appMaster>
>   <appMaster>
>   ...
>   </appMaster>
> </resourceRequests>
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message