hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naganarasimha G R (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-6524) Avoid storing unnecessary information in the Memory for the finished apps
Date Tue, 25 Apr 2017 02:30:04 GMT
Naganarasimha G R created YARN-6524:
---------------------------------------

             Summary: Avoid storing unnecessary information in the Memory for the finished
apps
                 Key: YARN-6524
                 URL: https://issues.apache.org/jira/browse/YARN-6524
             Project: Hadoop YARN
          Issue Type: Bug
          Components: RM
    Affects Versions: 2.7.3
            Reporter: Naganarasimha G R


Avoid storing unnecessary information in the Memory for the finished apps
In case of cluster with large number of finished apps, more memory is required to store the
unused information i.e. related AM's Container launch like Localization resources, tokens
etc. 
In one such scenario we had around 9k finished apps each with 257 LocalResource amounting
to 108 kbytes per app and just for 9k apps it was nearly taking ~ 0.8 GB of memory. In Low
end machines this would create resource crunch in RM




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message