hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shing Hing Man <mat...@yahoo.com>
Subject Pseudo distributed mode : How to increase no of concurrent map task
Date Sat, 29 Sep 2012 19:06:15 GMT
 
Hi, 
I am running Hadoop 1.03 in Pseudo  distributed mode, on a quad core Xeon processor with 
hyper-threading enabled. 
When I  submit a job to process a file of  size about 1.6 GB,  only two concurrent map tasks

are running. 
I have set 
mapred.tasktracker.map.tasks.maximum to 6.
In job.xml, 
mapred.map.tasks =25
mapred.min.split.size =0
dfs.block.size = 64MB
How to increase the the number of concurrent map task ?

Thanks in advance for any assistance !

Shing 


Mime
View raw message