hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hrishikesh Gadre <gadreonl...@gmail.com>
Subject Hadoop scheduler and number of reducers config
Date Wed, 13 Apr 2011 12:58:42 GMT
Hello All,

I have a question regarding configuring the number of reducers property in
case of a non FIFO scheduler (either Capacity/Fair-share scheduler).

As per the guidelines on the Hadoop wiki page, we should set number of
reducers = 0.75 * maximum_reduce_slots_available_in_cluster (minimum)
http://wiki.apache.org/hadoop/HowManyMapsAndReduces

Is it also valid for non FIFO schedulers? If not what is the general
configuration used in such cases?

Regards
Hrishikesh

Mime
View raw message