hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hong Tang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1379) Limit both numMapTasks and numReduceTasks
Date Fri, 15 Jan 2010 07:43:54 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800602#action_12800602
] 

Hong Tang commented on MAPREDUCE-1379:
--------------------------------------

Bochun, have you done any evaluation as to in what situations this additional knob helps?

> Limit both numMapTasks and numReduceTasks
> -----------------------------------------
>
>                 Key: MAPREDUCE-1379
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1379
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: tasktracker
>    Affects Versions: 0.22.0
>            Reporter: Bochun Bai
>            Priority: Trivial
>         Attachments: limit-both-numMapTasks-and-numReduceTasks.patch
>
>
> In some environment, the number of concurrent running process is very sensitive.
>   mapreduce.tasktracker.map.tasks.maximum
> and
>   mapreduce.tasktracker.reduce.tasks.maximum
> limit tasks running on each tasktracker separately.
> This patch limits them together, using mapreduce.tasktracker.total.tasks.maximum

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message