hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timothy St. Clair (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-977) Interface for users/AM to know actual usage by the container
Date Fri, 26 Jul 2013 14:01:49 GMT

    [ https://issues.apache.org/jira/browse/YARN-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13720810#comment-13720810

Timothy St. Clair commented on YARN-977:

Usage statistics can also be reported via cgroups.
> Interface for users/AM to know actual usage by the container
> ------------------------------------------------------------
>                 Key: YARN-977
>                 URL: https://issues.apache.org/jira/browse/YARN-977
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Omkar Vinit Joshi
> Today we allocate resource (memory and cpu) and node manager starts the container with
requested resource [I am assuming they are using cgroups]. But there is definitely a possibility
of users requesting more than what they actually may need during the execution of their container/job-task.
If we add a way for users/AM to know the actual usage of the requested/completed container
then they may optimize it for next run..
> This will be helpful for AM to optimize cpu/memory resource requests by querying NM/RM
to know avg/max cpu/memory usage of the container or may be containers belonging to application.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message