hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raj V <rajv...@yahoo.com>
Subject Re: Map Task Capacity Not Changing
Date Thu, 15 Dec 2011 23:46:50 GMT
Joey

What is it do you really want to do? Increase the number of map slots available in the task
tracker  or do you want to increase the number of map tasks for a job?

If you want to increase the number of map slots available, what you did will work - as long
as you restarted the task tracker or the node.
If you want to increase the number of map jobs - you will have to play with, simplistically
speaking, either the number of input files or input block size.

Raj

>________________________________
> From: Joey Krabacher <jkrabacher@gmail.com>
>To: common-user@hadoop.apache.org 
>Sent: Thursday, December 15, 2011 3:30 PM
>Subject: Map Task Capacity Not Changing
> 
>I have looked up how to up this value on the web and have tried all
>suggestions to no avail.
>
>Any help would be great.
>
>Here is some background:
>
>Version: 0.20.2, r911707
>Compiled: Fri Feb 19 08:07:34 UTC 2010 by chrisdo
>
>Nodes: 5
>Current Map Task Capacity : 10  <--- this is what I want to increase.
>
>What I have tried :
>
>Adding
>   <property>
>    <name>mapred.tasktracker.map.tasks.maximum</name>
>    <value>8</value>
>    <final>true</final>
>  </property>
>to mapred-site.xml on NameNode.  I also added this to one of the
>datanodes for the hell of it and that didn't work either.
>
>Thanks.
>
>
>
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message