Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 11014 invoked from network); 4 Dec 2009 00:32:26 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 4 Dec 2009 00:32:26 -0000 Received: (qmail 47390 invoked by uid 500); 4 Dec 2009 00:32:24 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 47296 invoked by uid 500); 4 Dec 2009 00:32:24 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 47286 invoked by uid 99); 4 Dec 2009 00:32:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Dec 2009 00:32:24 +0000 X-ASF-Spam-Status: No, hits=-2.6 required=5.0 tests=AWL,BAYES_00,HTML_MESSAGE X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of zjffdu@gmail.com designates 209.85.160.50 as permitted sender) Received: from [209.85.160.50] (HELO mail-pw0-f50.google.com) (209.85.160.50) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Dec 2009 00:32:22 +0000 Received: by pwi5 with SMTP id 5so939157pwi.29 for ; Thu, 03 Dec 2009 16:32:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type; bh=hW6qu0wQirLAKIHbE20HXLi7HP5mc+ByffczQsc60e0=; b=Iyt2cujWFtiyvI2sHW3xD/BYsvIHV7vl0aEkkQJR9xXuVFF53FjZc4CPv06duzym+7 0TgMukgD3Kx9BorZIP/oT7ECgGMI+vZODbqdnbKD94qcTXEcCwQ80JowB4GAMLKnDe7y x6sIN4m57ygRerABIl2ILIMZ2gL1Q2d/9C2t8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=jjT3v5WsblgFLpwUT7HZhOhzGEmjlyFnQ9LqLyGO1IeDGBhFGrj6qlXaLKDQp572wE 8krKJUUdyWzl7EfcNC18wCCrXwOHElReO0XQ91suO5vm/RvLWOVi2FWK4DLpRoXQ13Fk oIsygpSSKuvBzRnL6zuE+Yy71Ca72U6bbbKcQ= MIME-Version: 1.0 Received: by 10.142.60.19 with SMTP id i19mr250290wfa.315.1259886721749; Thu, 03 Dec 2009 16:32:01 -0800 (PST) In-Reply-To: <2d9b8f430912031458scc6518ds89ef2338c82964bb@mail.gmail.com> References: <2d9b8f430912031458scc6518ds89ef2338c82964bb@mail.gmail.com> Date: Thu, 3 Dec 2009 16:32:01 -0800 Message-ID: <8211a1320912031632q75874d37mf83df169e0d162fa@mail.gmail.com> Subject: Re: only one reduce task? From: Jeff Zhang To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=00504502ad1081d53b0479dc3c11 --00504502ad1081d53b0479dc3c11 Content-Type: text/plain; charset=UTF-8 Mike, Do you mean you only have one reducer task for a Job ? You can increase the number of reducer task for one Job by setting JobConf.setNumReduceTasks(n) Jeff Zhang On Thu, Dec 3, 2009 at 2:58 PM, Mike Kendall wrote: > i can't seem to get my cluster to run more than one reduce task... my > mapred-site.xml looks like this: > > > > > > > > mapred.job.tracker > master:9001 > > > mapred.tasktracker.map.tasks.maximum > 5 > > > > mapred.tasktracker.reduce.tasks.maximum > 5 > > > mapred.map.tasks > 40 > > > mapred.reduce.tasks > 8 > > > mapred.jobtracker.taskScheduler > org.apache.hadoop.mapred.FairScheduler > > > mapred.fairscheduler.allocation.file > /usr/local/hadoop/conf/fairshare-pools.xml > > > > any ideas? thanks. > --00504502ad1081d53b0479dc3c11--