hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1195) Task resource utilization reporting for profiling and scheduling
Date Fri, 06 Nov 2009 21:17:32 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12774409#action_12774409
] 

Arun C Murthy commented on MAPREDUCE-1195:
------------------------------------------

How is this different from MAPREDUCE-220 ?

> Task resource utilization reporting for profiling and scheduling
> ----------------------------------------------------------------
>
>                 Key: MAPREDUCE-1195
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1195
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Scott Chen
>
> We can make TaskTracker reports its usage on CPU, memory, bandwidth to JobTracker. JobTracker
can use the information for scheduling tasks and profiling jobs. 
> One way to do this is to first make ProcfsProcessTree to collect the utilization information
(CPU, mem...) and write the information in TaskTrackerStatus.taskReports and send them with
the heartbeats. Then we can aggregate these information in JobInProgress to do job profiling
and scheduling.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message