hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@apache.org>
Subject Re: Limiting the total number of tasks per task tracker
Date Fri, 25 Sep 2009 15:09:55 GMT
Oliver Senn wrote:
> Hi,
> Thanks for your answer.
> I used these parameters. But they seem to limit only the number of 
> parallel maps and parallel reduces separately. They do not prevent the 
> scheduler from schedule one map and one reduce on the same task tracker 
> in parallel.
> But that's the problem I'm trying to solve. Having at most one task 
> running on a task tracker at any time (never one map and one reduce 
> together on one task tracker).

You could do your own scheduler, if you really can't handle the things 
in parallel

View raw message