hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Keren Ouaknine <ker...@gmail.com>
Subject Re: #number of mappers
Date Wed, 30 Nov 2011 05:03:38 GMT
Indeed, that was the problem, thanks!
Keren

On Mon, Nov 28, 2011 at 10:46 PM, Harsh J <harsh@cloudera.com> wrote:

> Keren,
>
> Seems to work alright for me once I set these and restart each
> TaskTracker. Perhaps the problem is merely that you're missing an opening
> <property> XML tag for the second configuration, in that copy-paste below?
>
>
> On Tue, Nov 29, 2011 at 8:44 AM, Keren Ouaknine <kereno@gmail.com> wrote:
>
>> Thanks Harsh, the property in already set to one on all the nodes (see
>> below).
>> What do you reckon?
>>
>> <property>
>>     <name>mapred.tasktracker.map.tasks.maximum</name>
>>     <value>1</value>
>>     <description>The maximum number of map tasks that will be run
>> simultaneously by a task tracker.</description>
>> </property>
>>     <name>mapred.tasktracker.reduce.tasks.maximum</name>
>>     <value>1</value>
>>     <description>The maximum number of reduce tasks that will be run
>> simultaneously by a task tracker.</description>
>> </property>
>> </configuration>
>>
>>
>> On Thu, Nov 24, 2011 at 10:45 PM, Harsh J <harsh@cloudera.com> wrote:
>>
>>> Keren,
>>>
>>> What was your configured property at the TaskTrackers? The right
>>> property is mapred.tasktracker.{map,reduce}.tasks.maximum, and applies to
>>> each TaskTracker individually (so all your TT mapred-site.xml need to carry
>>> that property to limit their slots).
>>>
>>> On 25-Nov-2011, at 8:45 AM, Keren Ouaknine wrote:
>>>
>>> Hello,
>>>
>>> I configured mapred-site.xml with one mapper, still the web ui shows:
>>> Map shows capacity 40 = 2 x #machines. I was expecting it to be 20.
>>> Any idea?
>>>
>>> Thanks,
>>> Keren
>>>
>>>
>>> Running Map TasksRunning Reduce TasksTotal SubmissionsNodesOccupied Map
>>> SlotsOccupied Reduce Slots Reserved Map SlotsReserved Reduce SlotsMap
>>> Task CapacityReduce Task CapacityAvg. Tasks/NodeBlacklisted NodesGraylisted
>>> NodesExcluded Nodes 3420720<http://10.239.24.12:50030/machines.jsp?type=active>
>>> 34200040203.000<http://10.239.24.12:50030/machines.jsp?type=blacklisted>
>>> 0 <http://10.239.24.12:50030/machines.jsp?type=graylisted>0<http://10.239.24.12:50030/machines.jsp?type=excluded>
>>> --
>>>  Keren Ouaknine
>>> Cell: +972 54 2565404
>>> Web: www.kereno.com
>>>
>>>
>>>
>>>
>>
>>
>> --
>> Keren Ouaknine
>> Cell: +972 54 2565404
>> Web: www.kereno.com
>>
>>
>>
>
>
> --
> Harsh J
>



-- 
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com

Mime
View raw message