hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-944) Extend FairShare scheduler to fair-share memory usage in the cluster
Date Wed, 02 Sep 2009 01:12:32 GMT
Extend FairShare scheduler to fair-share memory usage in the cluster
--------------------------------------------------------------------

                 Key: MAPREDUCE-944
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-944
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: contrib/fair-share
            Reporter: dhruba borthakur


The FairShare Scheduler has an extensible LoadManager API to regulate allocating new tasks
on a particular TaskTracker. In similar lines, it would be nice if the FairShare Scheduler
can have a pluggable policy to regulate new tasks from a particular job. This will allow one
to skip scheduling tasks of a job that  is eating a large percentage of memory in the cluster,
i.e. fair-share of memory resources among jobs. 


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message