Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9CE94200D14 for ; Tue, 3 Oct 2017 09:05:08 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 9B09E160BD7; Tue, 3 Oct 2017 07:05:08 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E198B1609D2 for ; Tue, 3 Oct 2017 09:05:07 +0200 (CEST) Received: (qmail 26882 invoked by uid 500); 3 Oct 2017 07:05:07 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 26869 invoked by uid 99); 3 Oct 2017 07:05:06 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Oct 2017 07:05:06 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id ECE69180931 for ; Tue, 3 Oct 2017 07:05:05 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id ceNbm9lWBwaA for ; Tue, 3 Oct 2017 07:05:05 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id B115661271 for ; Tue, 3 Oct 2017 07:05:04 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 9D89DE2571 for ; Tue, 3 Oct 2017 07:05:02 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id AA112242F7 for ; Tue, 3 Oct 2017 07:05:00 +0000 (UTC) Date: Tue, 3 Oct 2017 07:05:00 +0000 (UTC) From: "Naganarasimha G R (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Tue, 03 Oct 2017 07:05:08 -0000 [ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16189338#comment-16189338 ] Naganarasimha G R commented on YARN-65: --------------------------------------- Thanks for reviewing and committing the patch [~rohithsharma], but was wondering why not for 2.7 branch (2.7.5 version release) too, as many want to store more applications in the absence of reliable ATS in the existing deployed clusters. Thoughts? > Reduce RM app memory footprint once app has completed > ----------------------------------------------------- > > Key: YARN-65 > URL: https://issues.apache.org/jira/browse/YARN-65 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager > Affects Versions: 0.23.3 > Reporter: Jason Lowe > Assignee: Manikandan R > Fix For: 2.9.0, 3.0.0-beta1, 3.1.0 > > Attachments: YARN-65.001.patch, YARN-65.002.patch, YARN-65.003.patch, YARN-65.004.patch, YARN-65.005.patch, YARN-65.006.patch, YARN-65.007.patch, YARN-65.008.patch, YARN-65.009.patch, YARN-65.010.patch, YARN-65.011.patch, YARN-65.012.patch, YARN-65.013.patch, YARN-65.014.patch, YARN-65.015.patch > > > The ResourceManager holds onto a configurable number of completed applications (yarn.resource.max-completed-applications, defaults to 10000), and the memory footprint of these completed applications can be significant. For example, the {{submissionContext}} in RMAppImpl contains references to protocolbuffer objects and other items that probably aren't necessary to keep around once the application has completed. We could significantly reduce the memory footprint of the RM by releasing objects that are no longer necessary once an application completes. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org For additional commands, e-mail: yarn-issues-help@hadoop.apache.org