hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohith Sharma K S <rohithsharm...@huawei.com>
Subject RE: mapred.reduce.tasks
Date Wed, 22 Apr 2015 04:54:45 GMT
Hi

In MapReduce , number of reducers launched is set by property “mapreduce.job.reduces”.
And via java API Job#setNumReduceTasks(int tasks).

In your MR job, somewhere in the program  they are setting number of reducer task using java
API or property. May be you can check the MR job or property file or configuration file which
are loading at client.

Thanks & Regards
Rohith Sharma K S

From: Shushant Arora [mailto:shushantarora09@gmail.com]
Sent: 21 April 2015 18:26
To: user@hive.apache.org
Subject: mapred.reduce.tasks

In MapReduce job how reduce tasks numbers are decided ?
I haven't override the mapred.reduce.tasks property and its creating ~700 reduce tasks.

Thanks
Mime
View raw message