hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Runping Qi (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1728) Hadoop should allow the task trackerto to have different mapper/reducer task limits
Date Fri, 17 Aug 2007 02:17:30 GMT
Hadoop should allow the task trackerto to have different mapper/reducer task limits
-----------------------------------------------------------------------------------

                 Key: HADOOP-1728
                 URL: https://issues.apache.org/jira/browse/HADOOP-1728
             Project: Hadoop
          Issue Type: Improvement
          Components: mapred
            Reporter: Runping Qi




Right now, Hadoop has one configuration variable to set the limit on the number of tasks 
per task tracker. That number applies to both the mappers and reducers. However, in many
cases, it make a lot of sense to set different limits on them, For example, since mappers

are typically take less resources than reducers, we can set 4 as the limit on mappers
and 2 on reducers. This will improve the cluster utilization and improve the
overall performance.



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message