hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vincent Behar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4849) TaskSelector not used in FairScheduler
Date Wed, 05 Dec 2012 13:44:57 GMT
Vincent Behar created MAPREDUCE-4849:

             Summary: TaskSelector not used in FairScheduler
                 Key: MAPREDUCE-4849
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4849
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: contrib/fair-share
    Affects Versions: 1.1.1, 1.0.4
            Reporter: Vincent Behar

The documentation (http://hadoop.apache.org/docs/r1.0.4/fair_scheduler.html) describes the
mapred.fairscheduler.taskselector parameter as an "extension point", but while the FairScheduler
does instantiate the custom TaskSelector provided this way, it does not call any of its methods
(obtainNewMapTask, obtainNewReduceTask, neededSpeculativeMaps or neededSpeculativeReduces).

We should either update the FairScheduler to use the TaskSelector when scheduling a task,
or completely remove the TaskSelector and update the documentation.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message