hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <qwertyman...@gmail.com>
Subject Re: mapred.reduce.tasks.speculative.execution config option in hadoop-0.21
Date Wed, 22 Dec 2010 17:32:59 GMT
Hi,

2010/12/22 Paweł Łoziński <pawel.lozinski@gmail.com>:
> Hi all,
>
> a quick question: is the config option name
> "mapred.reduce.tasks.speculative.execution" valid in hadoop-0.21, or
> did it change since 0.20?

It has changed. Those names are now deprecated.

New names are (still booleans):
mapreduce.map.speculative
mapreduce.reduce.speculative

There are also three new configurables for speculative execution control:
* mapreduce.job.speculative.speculativecap
* mapreduce.job.speculative.slowtaskthreshold
* mapreduce.job.speculative.slownodethreshold

See the defaults' xml for more details on them :)

-- 
Harsh J
www.harshj.com

Mime
View raw message