hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Omkar Vinit Joshi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-977) Interface for users/AM to know actual usage by the container
Date Fri, 26 Jul 2013 00:13:48 GMT
Omkar Vinit Joshi created YARN-977:

             Summary: Interface for users/AM to know actual usage by the container
                 Key: YARN-977
                 URL: https://issues.apache.org/jira/browse/YARN-977
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Omkar Vinit Joshi

Today we allocate resource (memory and cpu) and node manager starts the container with requested
resource [I am assuming they are using cgroups]. But there is definitely a possibility of
users requesting more than what they actually may need during the execution of their container/job-task.
If we add a way for users/AM to know the actual usage of the requested/completed container
then they may optimize it for next run..

This will be helpful for AM to optimize cpu/memory resource requests by querying NM/RM to
know avg/max cpu/memory usage of the container or may be containers belonging to application.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message