hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anil gupta <anilgupt...@gmail.com>
Subject Setting number of mappers in Teragen
Date Wed, 26 Dec 2012 18:19:58 GMT
Hi All,

I have 5 worker nodes and i have 4 map slots per node. So, i have 20 map
slots in my cluster. But when, i start my Teragen job, it only spawns 2
mappers for entire job. I have even tried using the option -Dmapred.map.tasks
= 20 . Can anyone tell me how to force teragen to use 20 mappers for
generating the data? I am using cdh4.1.2 with Mapreducev1(Hadoop 0.20.2)
Thanks & Regards,
Anil Gupta

View raw message