hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From abhishek sharma <absha...@usc.edu>
Subject Re: posted again: how are the splits for map tasks computed?
Date Thu, 25 Mar 2010 06:04:35 GMT
Ravi,

On Wed, Mar 24, 2010 at 9:32 PM, Ravi Phulari <rphulari@yahoo-inc.com> wrote:
> Hello Abhishek ,
>
> Unless you have modified conf/mapred-site.xml file MapReduce will  use
> configuration values specified in $HADOOP_HOME/src/mapred/mapred-default.xml
> In this configuration file mapred.map.tasks is configured as 2. And due to
> this your job is running 2 map tasks.
>
> <property>
>   <name>mapred.map.tasks</name>
>   <value>2</value>
>   <description>The default number of map tasks per job.
>   Ignored when mapred.job.tracker is "local".
>   </description>
> </property>

I tried setting mapred.map.tasks to 1 but the jobtracker still started
2 map tasks.

However, setting # map tasks to 1 for "loadgen" worked.

Cheers,
Abhishek

Mime
View raw message