Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Tue, 29 Aug 2017 11:08:00 +0000 (UTC)
From: "Rohith Sharma K S (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.12545669.1331221158000.145287.1504004880452@Atlassian.JIRA>
In-Reply-To: <JIRA.12545669.1331221158000@Atlassian.JIRA>
References: <JIRA.12545669.1331221158000@Atlassian.JIRA> <JIRA.12545669.1331221158972@jira-lw-us.apache.org>
Subject: [jira] [Commented] (YARN-65) Reduce RM app memory footprint once
 app has completed
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Tue, 29 Aug 2017 11:08:07 -0000


    [ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145116#comment-16145116 ] 

Rohith Sharma K S commented on YARN-65:
---------------------------------------

bq. Test cases using MemoryRMStateStore were not passing because of NPE during recovery process
All most all test cases uses MemoryRMStateStore! Its better to clone while storing in MemoryRMStateStore#state rather than changing each and every test cases. In future, if any more restart tests get added that reduces this failure. 

> Reduce RM app memory footprint once app has completed
> -----------------------------------------------------
>
>                 Key: YARN-65
>                 URL: https://issues.apache.org/jira/browse/YARN-65
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: resourcemanager
>    Affects Versions: 0.23.3
>            Reporter: Jason Lowe
>            Assignee: Manikandan R
>         Attachments: YARN-65.001.patch, YARN-65.002.patch, YARN-65.003.patch, YARN-65.004.patch, YARN-65.005.patch, YARN-65.006.patch, YARN-65.007.patch, YARN-65.008.patch, YARN-65.009.patch, YARN-65.010.patch
>
>
> The ResourceManager holds onto a configurable number of completed applications (yarn.resource.max-completed-applications, defaults to 10000), and the memory footprint of these completed applications can be significant.  For example, the {{submissionContext}} in RMAppImpl contains references to protocolbuffer objects and other items that probably aren't necessary to keep around once the application has completed.  We could significantly reduce the memory footprint of the RM by releasing objects that are no longer necessary once an application completes.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org