hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yang Hao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-6176) To limit the number of map task or reduce number an application
Date Fri, 28 Nov 2014 06:24:12 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yang Hao updated MAPREDUCE-6176:
--------------------------------
    Summary: To limit the number of map task or reduce number an application  (was: Users
should limit the number of an application)

> To limit the number of map task or reduce number an application
> ---------------------------------------------------------------
>
>                 Key: MAPREDUCE-6176
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6176
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>          Components: mr-am, mrv2
>    Affects Versions: 2.5.0, 2.4.1, 2.5.1, 2.5.2
>            Reporter: Yang Hao
>            Assignee: Yang Hao
>              Labels: patch
>             Fix For: 2.4.1
>
>         Attachments: MAPREDUCE-6176.patch
>
>
> As MapReduce is a batch framework of calculation, so people may want to run application
A as well as application B 、C, but a limit resource should be added on A. A good way to
do so is that we can limit the number of application's map task or reduce task. If we set
mapreduce.map.num.max as M, then the map task number will not exceed M. At the same time,
if we set mapreduce.map.num.max as R, then the reduce task number will not exceed R



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message