hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: How set number of map and reduce can run simultaneously
Date Tue, 24 May 2011 07:01:18 GMT
How many tasks are present in your job? Do all tasktrackers carry this
configuration? What is the total reported slot capacity on the JT UI?

On Mon, May 23, 2011 at 10:28 PM, Pedro Costa <psdc1978@gmail.com> wrote:
> I think I've to rephrase the question.
>
> I set the "mapred.tasktracker.map.tasks.maximum" to 8, hoping that it
> will run 8*10 map tasks in the whole cluster. But, it only run 8 tasks
> simultaneously. Why this is happens?
>
> On Mon, May 23, 2011 at 5:45 PM, Pedro Costa <psdc1978@gmail.com> wrote:
>> Hi,
>>
>> I'm running hadoop map-reduce in a cluster with 10 machines. I would
>> like to set in the configuration that each tasktracker can run 8 map
>> tasks simultaneously and 4 reduce tasks simultaneously.  Which
>> parameters should I configure?
>>
>> Thanks,
>> PSC
>>
>



-- 
Harsh J

Mime
View raw message