hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Set the number of maps
Date Thu, 01 Nov 2012 16:55:15 GMT
It can't be set from the code this way - the slot property is applied
at the TaskTracker service level (as the name goes).

Since you're just testing at the moment, try to set these values,
restart TTs, and run your jobs again. You do not need to restart JT at
any point for tweaking these values.

On Thu, Nov 1, 2012 at 7:13 PM, Cogan, Peter (Peter)
<Peter.Cogan@alcatel-lucent.com> wrote:
> Hi
> I understand that the maximum number of concurrent map tasks is set by
> mapred.tasktracker.map.tasks.maximum  - however I wish to run with a smaller
> number of maps (am testing disk IO). I thought that I could set that within
> the main program using
> conf.set("mapred.tasktracker.map.tasks.maximuma", "4");
> to run with 4 maps – but that seems to have no impact. I know I could just
> change the mapred-site.xml and restart map reduce but that's kind of a pain.
> Can it be set from within the code?
> Thanks
> Peter

Harsh J

View raw message