hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-944) Extend FairShare scheduler to fair-share memory usage in the cluster
Date Tue, 08 Sep 2009 20:25:57 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12752720#action_12752720
] 

Scott Chen commented on MAPREDUCE-944:
--------------------------------------

I wonder where why there are test errors. canLaunchTask only returns true so it shouldn't
change anything. I have applied this patch and run ant clean test. It shows no test error.

> Extend FairShare scheduler to fair-share memory usage in the cluster
> --------------------------------------------------------------------
>
>                 Key: MAPREDUCE-944
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-944
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: contrib/fair-share
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
>             Fix For: 0.21.0
>
>         Attachments: LoadManager.txt, LoadManager2.txt
>
>
> The FairShare Scheduler has an extensible LoadManager API to regulate allocating new
tasks on a particular TaskTracker. In similar lines, it would be nice if the FairShare Scheduler
can have a pluggable policy to regulate new tasks from a particular job. This will allow one
to skip scheduling tasks of a job that  is eating a large percentage of memory in the cluster,
i.e. fair-share of memory resources among jobs. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message