hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1739) Collecting CPU and memory usage for MapReduce jobs
Date Wed, 28 Apr 2010 20:43:48 GMT
Collecting CPU and memory usage for MapReduce jobs
--------------------------------------------------

                 Key: MAPREDUCE-1739
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1739
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
            Reporter: Scott Chen
            Assignee: Scott Chen


MAPREDUCE-220 collects CPU and memory usage for each task.
We can aggregate them to get the information per job. Such information can be used for scheduling,
profiling or charging the users based on the resource they consumed.

Here are some information that should be useful:
1. Total CPU cycles (# of giga-cycles)
2. Total Memory occupied time (GB-sec)
3. Maximum peak memory on one task (GB)
4. Maximum peak CPU on one task (GHz)

Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message