hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <ja...@attributor.com>
Subject Re: Override mapred.tasktracker.tasks.maximum?
Date Thu, 07 Feb 2008 17:00:23 GMT
This should be one of the features coming in 0.16 via HOD

Steve Schlosser wrote:
> Hello all
> Is it possible for a Hadoop program to override
> mapred.tasktracker.tasks.maximum at runtime?  I've found that my job
> overloads our nodes when running our default 8 tasks per node, but if
> I decrease mapred.tasktracker.tasks.maximum in the config file and
> restart the cluster it seems to go fine.  However, when I tried to set
> this parameter in my program it seemed to be ignored.  I'd like to set
> this at runtime rather than having to restart the cluster.  Is this
> only read when tasktrackers are started or can I override it?
> Thanks!
> -steve

View raw message