hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6524) Avoid storing unnecessary information in the Memory for the finished apps
Date Tue, 25 Apr 2017 14:40:04 GMT

    [ https://issues.apache.org/jira/browse/YARN-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982974#comment-15982974
] 

Jason Lowe commented on YARN-6524:
----------------------------------

This is a duplicate of YARN-65.

> Avoid storing unnecessary information in the Memory for the finished apps
> -------------------------------------------------------------------------
>
>                 Key: YARN-6524
>                 URL: https://issues.apache.org/jira/browse/YARN-6524
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: RM
>    Affects Versions: 2.7.3
>            Reporter: Naganarasimha G R
>
> Avoid storing unnecessary information in the Memory for the finished apps
> In case of cluster with large number of finished apps, more memory is required to store
the unused information i.e. related AM's Container launch like Localization resources, tokens
etc. 
> In one such scenario we had around 9k finished apps each with 257 LocalResource amounting
to 108 kbytes per app and just for 9k apps it was nearly taking ~ 0.8 GB of memory. In Low
end machines this would create resource crunch in RM



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message