hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1167) Make ProcfsBasedProcessTree collect rss memory information
Date Fri, 06 Nov 2009 10:52:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774269#action_12774269

Vinod K V commented on MAPREDUCE-1167:

Quickly looked at your patch. Few questions:
 - Can you find out and put some details as to how standard is {{getconf}} command? Given
{{ProcfsBasedProcessTree}} is for Linux only, we are only concerned about Linux distributions.
I can find it on my Ubuntu dev box, but RHEL?
 - I think we should keep track of rssmem everywhere in terms of bytes. This would inclue
 - The behaviour when PAGESIZE is -ve should be changed. The patch gives out negative rss
sizes. Instead we should throw exceptions in {{ProcessInfo.getRss()}}, {{ProcfsBasedProcessTree.getCumulativeRssMem()}}

> Make ProcfsBasedProcessTree collect rss memory information
> ----------------------------------------------------------
>                 Key: MAPREDUCE-1167
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1167
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: tasktracker
>    Affects Versions: 0.20.1
>            Reporter: Scott Chen
>         Attachments: MAPREDUCE-1167-v2.patch, MAPREDUCE-1167.patch
> Right now ProcfsBasedProcess collects only virtual memory. We can make it collect rss
memory as well.
> Later we can use rss in TaskMemoryManagerThread to obtain better memory management.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message