hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Enis Soztutar <enis.soz.nu...@gmail.com>
Subject Re: Maximum # of Tasks
Date Mon, 03 Sep 2007 07:25:31 GMT
There is some obvious limitation in terms of memory usages in 
Jobtracker. Why would you want such enormous number of tasks?



Derek Gottfrid wrote:
> I tried to create a job that set the # of Tasks to 900k and it hung
> and then ended up killing it's self. The 900k should have been split
> over 300 machines but it never took. When I reduced the task # down to
> 200k it worked with out issue (over the same 300 machines). Are there
> any guidelines about maximum # of tasks ?
>
> thanks,
> derek
>
>   

Mime
View raw message