hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Scott Chen (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-2198) Allow FairScheduler to control the number of slots on each TaskTracker
Date Tue, 23 Nov 2010 02:40:14 GMT
Allow FairScheduler to control the number of slots on each TaskTracker
----------------------------------------------------------------------

                 Key: MAPREDUCE-2198
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2198
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: contrib/fair-share
    Affects Versions: 0.22.0
            Reporter: Scott Chen
            Assignee: Scott Chen
             Fix For: 0.22.0


We can set the number of slots on the TaskTracker to be high and let FairScheduler handles
the slots.
This approach allows us to change the number of slots on each node dynamically.
The administrator can change the number of slots with a CLI tool.

One use case of this is for upgrading the MapReduce.
Instead of restarting the cluster, we can run the new MapReduce on the same cluster.
And use the CLI tool to gradually migrate the slots.
This way we don't lost the progress fo the jobs that's already executed.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message