hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Renaud Delbru <renaud.del...@deri.org>
Subject Re: Best way to limit the number of concurrent tasks per job on hadoop 0.20.2
Date Sat, 29 Jan 2011 11:04:14 GMT
Hi Allen,

thanks for pointing this out.

On 28/01/11 17:34, Allen Wittenauer wrote:
>> As it seems that the capacity and fair schedulers in hadoop 0.20.2 do not allow a
hard upper limit in number of concurrent tasks, do anybody know any other solutions to achieve
this ?
> The specific change for capacity scheduler has been backported to 0.20.2 as part of https://issues.apache.org/jira/browse/MAPREDUCE-1105
.  Note that you'll also need https://issues.apache.org/jira/browse/MAPREDUCE-1160 which fixes
a logging bug in the JobTracker.  Otherwise your logs will fill up.
Renaud Delbru

View raw message