hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (Assigned) (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (MAPREDUCE-3987) Reduce RM app memory footprint once app has completed
Date Tue, 13 Mar 2012 19:32:40 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Eagles reassigned MAPREDUCE-3987:
------------------------------------------

    Assignee: Jonathan Eagles
    
> Reduce RM app memory footprint once app has completed
> -----------------------------------------------------
>
>                 Key: MAPREDUCE-3987
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3987
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2, resourcemanager
>    Affects Versions: 0.23.1
>            Reporter: Jason Lowe
>            Assignee: Jonathan Eagles
>
> The ResourceManager holds onto a configurable number of completed applications (yarn.resource.max-completed-applications,
defaults to 10000), and the memory footprint of these completed applications can be significant.
 For example, the {{submissionContext}} in RMAppImpl contains references to protocolbuffer
objects and other items that probably aren't necessary to keep around once the application
has completed.  We could significantly reduce the memory footprint of the RM by releasing
objects that are no longer necessary once an application completes.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message