hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-1001) YARN should provide per application-type and state statistics
Date Wed, 11 Sep 2013 07:48:53 GMT

     [ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhijie Shen updated YARN-1001:
------------------------------

    Attachment: YARN-1001.3.patch

New patch uploaded.

bq. We should have a single call which takes in a list of appStates, one app-type and return
the number of apps of THAT app-type and in ANY of those states. Don't think we should burden
the server to give all-way stats, that can be too much of a burden specifically given number
of app-types is unbounded.

Had some offline discussion with Vinod, and decided to support single applicationType now,
and worked on the multiple applicationTypes  later.

To be elegant to support multiple applicationTypes, we keep the current array structure for
the response, for the sake of compatible API change in the future.

bq. Lets call the service as /appstatistics just in case we want to add more in future.

Done

bq. rename the parameters as states and applicationTypes to be consistent with /apps API.

Done

bq. Update the documentation after the above renames.

Done. Also mentioned that more than one applicationType is not allowed temporarily, and the
params are case insensitive

bq. Similarly, AppsCountInfo -> ApplicationStatisticsInfo. For now it will just return
one object: {states:RUNNING,FINISHED, appTypes:MAPREDUCE, count:3}

Done.

bq. Refactor getApps() API also to use the new method parseQueries()

Done. Also make the applicationTypes in getApps() case insensitive as well.

In addition to the comments, I've also changed the behavior of no params. When no params,
the API returns all the number of apps in RMContext, which is documented as well.
                
> YARN should provide per application-type and state statistics
> -------------------------------------------------------------
>
>                 Key: YARN-1001
>                 URL: https://issues.apache.org/jira/browse/YARN-1001
>             Project: Hadoop YARN
>          Issue Type: Task
>          Components: api
>    Affects Versions: 2.1.0-beta
>            Reporter: Srimanth Gunturi
>            Assignee: Zhijie Shen
>            Priority: Blocker
>         Attachments: YARN-1001.1.patch, YARN-1001.2.patch, YARN-1001.3.patch
>
>
> In Ambari we plan to show for MR2 the number of applications finished, running, waiting,
etc. It would be efficient if YARN could provide per application-type and state aggregated
counts.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message