hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4681) ProcfsBasedProcessTree should not calculate private clean pages
Date Tue, 09 Feb 2016 17:54:18 GMT

    [ https://issues.apache.org/jira/browse/YARN-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139292#comment-15139292
] 

Chris Nauroth commented on YARN-4681:
-------------------------------------

Linking to YARN-1775, which initially implemented the support for reading /proc/<PID>/smaps
information.  Also notifying a few of the participants on that earlier discussion: [~rajesh.balamohan],
[~kasha@cloudera.com] and [~vinodkv].

This issue relates to this discussion on the dev mailing list:

http://mail-archives.apache.org/mod_mbox/hadoop-yarn-dev/201602.mbox/%3CD2DF3D85.3AAF8%25cnauroth%40hortonworks.com%3E

> ProcfsBasedProcessTree should not calculate private clean pages
> ---------------------------------------------------------------
>
>                 Key: YARN-4681
>                 URL: https://issues.apache.org/jira/browse/YARN-4681
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.6.0, 2.7.0
>            Reporter: Jan Lukavsky
>         Attachments: YARN-4681.patch
>
>
> ProcfsBasedProcessTree in Node manager calculates memory used by a process tree by parsing
{{/etc/<pid>/smaps}}, where it calculates {{min(Pss, Shared_Dirty) + Private_Dirty +
Private_Clean}}. Because not {{mlocked}} private clean pages can be reclaimed by kernel, this
should be changed to calculating only {{Locked}} pages instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message