hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yang Hao (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-6176) To limit the map task number or reduce task number of an application
Date Thu, 09 Apr 2015 09:17:13 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yang Hao resolved MAPREDUCE-6176.
---------------------------------
          Resolution: Duplicate
    Target Version/s:   (was: 2.4.0, 2.5.0, 2.4.1, 2.5.1, 2.5.2)

> To limit the map task number or reduce task number of an application
> --------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6176
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6176
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: mr-am, mrv2
>    Affects Versions: 2.4.0, 2.5.0, 2.4.1, 2.5.1, 2.5.2
>            Reporter: Yang Hao
>            Assignee: Yang Hao
>              Labels: patch
>         Attachments: MAPREDUCE-6176-branch2.4.0.patch
>
>
> As MapReduce is a batch framework of calculation, so people may want to run application
A as well as application B 、C, and a limit resource be put on A. A good way to do so is
that we can limit the number of application's map task or reduce task. If we set mapreduce.map.num.max
as M, then the map task number will not exceed M. At the same time, if we set mapreduce.map.num.max
as R, then the reduce task number will not exceed R



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message