hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Pseudo distributed mode : How to increase no of concurrent map task
Date Sat, 29 Sep 2012 19:23:18 GMT
Did you restart your TaskTrackers after increasing the
mapred.tasktracker.map.tasks.maximum value in mapred-site.xml? It is a
TaskTracker property, not a per-job one.

On Sun, Sep 30, 2012 at 12:36 AM, Shing Hing Man <matmsh@yahoo.com> wrote:
>
> Hi,
> I am running Hadoop 1.03 in Pseudo  distributed mode, on a quad core Xeon processor with
> hyper-threading enabled.
> When I  submit a job to process a file of  size about 1.6 GB,  only two concurrent map
tasks
> are running.
> I have set
> mapred.tasktracker.map.tasks.maximum to 6.
> In job.xml,
> mapred.map.tasks =25
> mapred.min.split.size =0
> dfs.block.size = 64MB
> How to increase the the number of concurrent map task ?
>
> Thanks in advance for any assistance !
>
> Shing
>



-- 
Harsh J

Mime
View raw message