hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Updated: (MAPREDUCE-1167) Make ProcfsBasedProcessTree collect rss memory information
Date Thu, 12 Nov 2009 00:36:40 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Scott Chen updated MAPREDUCE-1167:

    Attachment: MAPREDUCE-1167-v4.patch

1. Change TestProcfsBasedProcessTree.ProcessStatInfo so that it will not affect TestTaskTrackerMemoryManager.
2. Remove the change in TestTaskTrackerMemoryManager
3. I make getCumulativeRssmem return 0 if PAGE_SIZE is not available

The reason for 3 is because getCumulativeVmem and getCumulativeRssmem should be consistent.
When /proc/ is not available, getCumulativeVmem will return 0 instead of throwing Exception.
It is good to make them follow the same behavior.
And these situations should not happen if the system is linux.

> Make ProcfsBasedProcessTree collect rss memory information
> ----------------------------------------------------------
>                 Key: MAPREDUCE-1167
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1167
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: tasktracker
>    Affects Versions: 0.20.1
>            Reporter: Scott Chen
>            Assignee: Scott Chen
>         Attachments: MAPREDUCE-1167-v2.patch, MAPREDUCE-1167-v3.patch, MAPREDUCE-1167-v4.patch,
> Right now ProcfsBasedProcess collects only virtual memory. We can make it collect rss
memory as well.
> Later we can use rss in TaskMemoryManagerThread to obtain better memory management.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message