Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4DE9010AB6 for ; Thu, 14 Nov 2013 14:54:28 +0000 (UTC) Received: (qmail 45818 invoked by uid 500); 14 Nov 2013 14:54:17 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 44324 invoked by uid 500); 14 Nov 2013 14:54:13 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 44260 invoked by uid 99); 14 Nov 2013 14:54:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Nov 2013 14:54:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vincent.y.shen@gmail.com designates 209.85.128.177 as permitted sender) Received: from [209.85.128.177] (HELO mail-ve0-f177.google.com) (209.85.128.177) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Nov 2013 14:54:03 +0000 Received: by mail-ve0-f177.google.com with SMTP id jz11so1904871veb.22 for ; Thu, 14 Nov 2013 06:53:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=2RLJA9voRlIUs5R67JEApLo+mfyMg0aJr87pRy1GcYE=; b=luK9Fb4yYTqekPsjxq5N1E8HsH0ifkx41gnkSIsO3Wa/soTvLSpIGGUoOpYEi1S4MN dYiQTsk3OGXC+2I2dOnbgdcI+/PFRAra4vfKPnQW2PqtZ05RmgBJl3ifbBRBfcI3O/MC Ab4JwRrt8DPnaOPk/hq8ie8xDETa1P1lQKisxarbpFeHG1FLG9LCChyNXyV5EY/Jn4gC +zqbOddOdfnXXw7vjl8x3TqTRLo7aS/r9hkreqxeiiH2MKbpqw6HFIqKWBitMLZyIh// xcBUebYEOFqMY7Rx9KuKW6UV+yHUy0Gy3Hgnc01lKkSNueEX5rMBOKyd3W36nlbS2Ntg UFBw== MIME-Version: 1.0 X-Received: by 10.52.97.35 with SMTP id dx3mr949045vdb.18.1384440823061; Thu, 14 Nov 2013 06:53:43 -0800 (PST) Received: by 10.58.145.73 with HTTP; Thu, 14 Nov 2013 06:53:43 -0800 (PST) Date: Thu, 14 Nov 2013 14:53:43 +0000 Message-ID: Subject: mapred.tasktacker.reduce.tasks.maximum issue From: "Vincent Y. Shen" To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf307f31a878a6cc04eb243f6a X-Virus-Checked: Checked by ClamAV on apache.org --20cf307f31a878a6cc04eb243f6a Content-Type: text/plain; charset=ISO-8859-1 Hi Guys, I am increasing mapred.tasktacker.reduce.tasks.maximum in the hadoop cluster. But regardless whatever I tried, hadoop refuses to use my value but the default (2) What I did do =========== stop mapred stop dfs update the value of mapred.tasktacker.reduce.tasks.maximum start dfs start mapred But the system still uses default values Environment ========= Hadoop version: 1.1.2 Java version: 7 Mapred-site.xml ============ mapred.system.dir /hadoop/mapred/system mapred.reduce.tasks 50 mapred.tasktacker.reduce.tasks.maximum 15 mapred.tasktacker.map.tasks.maximum 15 mapred.child.java.opts -Xmx500m mapred.job.tracker machine1.mydomain.com:54311 Thanks guys for any pointers!!!! Best regards, Vincent. --20cf307f31a878a6cc04eb243f6a Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Guys,

I am increasing=A0mapred= .tasktacker.reduce.tasks.maximum in the hadoop cluster. But regardless what= ever I tried, hadoop refuses to use my value but the default (2)




What I did do
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

stop mapred
stop dfs

update the value of=A0mapred.tasktacker.reduce.tasks.maximum


start dfs
start mapred


But the system still uses default values




Environme= nt
=3D=3D=3D=3D=3D=3D=3D=3D=3D

Hadoop version: 1.1.2
Java version: 7


<= div style>Mapred-site.xml
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D

<property>
= =A0 <name>mapred.system.dir</name>
=A0 <value>/hadoop/mapred/system</value>
</pr= operty>



<prope= rty>
=A0 <name>mapred.reduce.tasks</name>
=A0 <value>50</value>
</property>
<property>
=A0 <name>mapred.tasktacker.re= duce.tasks.maximum</name>
=A0 <value>15</value>=
</property>

<property>
= =A0 <name>mapred.tasktacker.map.tasks.maximum</name>
= =A0 <value>15</value>
</property>

<property>
=A0 <name>mapred= .child.java.opts</name>
=A0 <value>-Xmx500m</value= >
</property>


<property>
=A0 <name>mapred.job.track= er</name>
=A0 <value>machine1.mydomain.com:54311</value>

=
</property>



Thanks guys for any pointers!!!!

<= div style>
Best regards,


Vincent.


--20cf307f31a878a6cc04eb243f6a--