hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-220) Collecting cpu and memory usage for MapReduce tasks
Date Tue, 17 Nov 2009 20:56:39 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779124#action_12779124
] 

Scott Chen commented on MAPREDUCE-220:
--------------------------------------

Dhruba and I discussed again. We think these information should be transmitted

A1. virtual memory used by each task (in bytes)
A2. physical memory used by each task (in bytes)
A3. cumulative cpu time used by each task (in millisecond)

B1. available physical memory on this machine (in bytes)
B2. cumulative used cpu time (for all cores) since the machine is up (in millisecond)
B3. cpu speed on this machine (in Hz)
B4. # of cpu cores on the machine

The cpu % can be obtained by looking at the difference of the reported cumulative cpu time.

> Collecting cpu and memory usage for MapReduce tasks
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-220
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-220
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Hong Tang
>            Assignee: Scott Chen
>
> It would be nice for TaskTracker to collect cpu and memory usage for individual Map or
Reduce tasks over time.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message