hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ajay Jadhav (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-6188) Fix OOM issue with decommissioningNodesWatcher in the case of clusters with large number of nodes
Date Thu, 16 Feb 2017 02:40:42 GMT

    [ https://issues.apache.org/jira/browse/YARN-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15869018#comment-15869018
] 

Ajay Jadhav commented on YARN-6188:
-----------------------------------

In the for loop, the string is appended couple of times. 
First to get the node information such as node id, status etc.
And also, for each node, it goes through all the app ids to get more information such as state,
application type etc.

StringBuilder looked more cleaner with all the formatting etc. due to which I kept it that
way. Let me know if there are any particular concerns.

> Fix OOM issue with decommissioningNodesWatcher in the case of clusters with large number
of nodes
> -------------------------------------------------------------------------------------------------
>
>                 Key: YARN-6188
>                 URL: https://issues.apache.org/jira/browse/YARN-6188
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.9.0
>            Reporter: Ajay Jadhav
>             Fix For: 2.9.0, 3.0.0-alpha1
>
>         Attachments: YARN-6188.001.patch, YARN-6188.002.patch
>
>
> LogDecommissioningNodesStatus method in DecommissioningNodesWatcher uses StringBuilder
to append status of all
> decommissioning nodes for logging purpose.
> In the case of large number of decommissioning nodes, this leads to OOM exception. The
fix scopes StringBuilder so that in case of memory pressure, GC can kick in and free up the
memory.
> This is supposed to fix a bug introduced in https://issues.apache.org/jira/browse/YARN-4676



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message