Mailing-List: contact mapreduce-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: mapreduce-issues@hadoop.apache.org
Message-ID: <1529858271.1258505379646.JavaMail.jira@brutus>
Date: Wed, 18 Nov 2009 00:49:39 +0000 (UTC)
From: "Scott Chen (JIRA)" <jira@apache.org>
To: mapreduce-issues@hadoop.apache.org
Subject: [jira] Commented: (MAPREDUCE-961) ResourceAwareLoadManager to
 dynamically decide new tasks based on current CPU/memory load on
 TaskTracker(s)
In-Reply-To: <176784587.1252387377875.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAPREDUCE-961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779228#action_12779228 ] 

Scott Chen commented on MAPREDUCE-961:
--------------------------------------

I created a sub-task for this one for collecting the TaskTracker resource in MAPREDUCE-1218.
I will factor out the codes for TaskTracker resource collecting there and leave the scheduling related codes here. 

> ResourceAwareLoadManager to dynamically decide new tasks based on current CPU/memory load on TaskTracker(s)
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-961
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-961
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: contrib/fair-share
>    Affects Versions: 0.22.0
>            Reporter: dhruba borthakur
>            Assignee: Scott Chen
>             Fix For: 0.22.0
>
>         Attachments: HIVE-961.patch, MAPREDUCE-961-v2.patch, MAPREDUCE-961-v3.patch, MAPREDUCE-961-v4.patch
>
>
> Design and develop a ResouceAwareLoadManager for the FairShare scheduler that dynamically decides how many maps/reduces to run on a particular machine based on the CPU/Memory/diskIO/network usage in that machine.  The amount of resources currently used on each task tracker is being fed into the ResourceAwareLoadManager in real-time via an entity that is external to Hadoop.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.