Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <1663066776.1257504752392.JavaMail.jira@brutus>
Date: Fri, 6 Nov 2009 10:52:32 +0000 (UTC)
From: "Vinod K V (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-1167) Make ProcfsBasedProcessTree
 collect rss memory information
In-Reply-To: <1690572128.1256845439370.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774269#action_12774269 ] 

Vinod K V commented on MAPREDUCE-1167:
--------------------------------------

Quickly looked at your patch. Few questions:
 - Can you find out and put some details as to how standard is {{getconf}} command? Given {{ProcfsBasedProcessTree}} is for Linux only, we are only concerned about Linux distributions. I can find it on my Ubuntu dev box, but RHEL?
 - I think we should keep track of rssmem everywhere in terms of bytes. This would inclue ProcessInfo.rssMem;
 - The behaviour when PAGESIZE is -ve should be changed. The patch gives out negative rss sizes. Instead we should throw exceptions in {{ProcessInfo.getRss()}}, {{ProcfsBasedProcessTree.getCumulativeRssMem()}} etc.

> Make ProcfsBasedProcessTree collect rss memory information
> ----------------------------------------------------------
>
>                 Key: MAPREDUCE-1167
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1167
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: tasktracker
>    Affects Versions: 0.20.1
>            Reporter: Scott Chen
>         Attachments: MAPREDUCE-1167-v2.patch, MAPREDUCE-1167.patch
>
>
> Right now ProcfsBasedProcess collects only virtual memory. We can make it collect rss memory as well.
> Later we can use rss in TaskMemoryManagerThread to obtain better memory management.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.