hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-5563) Fairshare scheduler always waits for 5% of maps to finish before scheduling reduces.
Date Tue, 24 Mar 2009 14:45:51 GMT
Fairshare scheduler always waits for 5% of maps to finish before scheduling reduces.
------------------------------------------------------------------------------------

                 Key: HADOOP-5563
                 URL: https://issues.apache.org/jira/browse/HADOOP-5563
             Project: Hadoop Core
          Issue Type: Bug
          Components: contrib/fair-share
            Reporter: Vinod K V


The FairScheduler.enoughMapsFinishedToRunReduces() method has a hard-coded 5% limit of number
of maps to finish before reduces can be scheduled, and this behaviour cannot be changed by
users/admins. This should in the minimum be configurable, perhaps using the same config property
that the framework uses - mapred.reduce.slowstart.completed.maps. Or better it should use
the JobInProgress.scheduleReduce() method itself directly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message