Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D09721848F for ; Fri, 26 Jun 2015 17:17:57 +0000 (UTC) Received: (qmail 64204 invoked by uid 500); 26 Jun 2015 17:17:52 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 64086 invoked by uid 500); 26 Jun 2015 17:17:52 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 64076 invoked by uid 99); 26 Jun 2015 17:17:51 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Jun 2015 17:17:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 7EA06181796 for ; Fri, 26 Jun 2015 17:17:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.791 X-Spam-Level: * X-Spam-Status: No, score=1.791 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-1.108, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 47lHfzlSx2Iw for ; Fri, 26 Jun 2015 17:17:50 +0000 (UTC) Received: from mail-lb0-f172.google.com (mail-lb0-f172.google.com [209.85.217.172]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 4008121044 for ; Fri, 26 Jun 2015 17:17:50 +0000 (UTC) Received: by lbnk3 with SMTP id k3so68492659lbn.1 for ; Fri, 26 Jun 2015 10:17:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=yMLG3idQbsj19DXIPxOtRufLCwXPhyvqzhYXpjun5eU=; b=MujmQeL8p9xTPJksFzukFH6UZ4KTPBEGpRY7lw59WMfJexMYSxRVN+YDFWT3vafTzG 1mv0EFFWc+DdP4VALD3VF8yAeYVHfzYnAgN8SNn5fgXbESuI4/W4NsnrrzkCHfBCbft5 nvbQnxhxc1Y1sldQn7fjzPfSexYWuGnYGqQOOSLo0DteAbo3TCO1oB83pFvUj/IXZyUc Oq3A2GK5SaIKV7rilhs1EXHxwP86YcNa6Hft27lCq6H6GbRChcC8cwQ97+sJ7SIADoBQ W8VHfdK03qb+cgUuwKsT+uHyYYfmn0IE4GI/zCQaBTKIIui9sDJIkfGNEyoaWEnjnrlB wtUg== MIME-Version: 1.0 X-Received: by 10.112.134.167 with SMTP id pl7mr2548322lbb.50.1435339068759; Fri, 26 Jun 2015 10:17:48 -0700 (PDT) Received: by 10.25.78.13 with HTTP; Fri, 26 Jun 2015 10:17:48 -0700 (PDT) In-Reply-To: References: Date: Fri, 26 Jun 2015 22:47:48 +0530 Message-ID: Subject: Re: Only one reducer working From: Ravikant Dindokar To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e011767f953649005196eeba7 --089e011767f953649005196eeba7 Content-Type: text/plain; charset=UTF-8 set the value directly in code. Given a JobConf instance job, call job.setNumReduceTasks(100); This worked for me Thanks On Fri, Jun 26, 2015 at 9:07 PM, Ravikant Dindokar wrote: > text file with tab separated values > > On Fri, Jun 26, 2015 at 7:35 PM, Krishna Kalyan > wrote: > >> What is the file format?. >> >> Thanks, >> Krishna >> On 26 Jun 2015 7:33 pm, "Ravikant Dindokar" >> wrote: >> >>> Hi Hadoop User, >>> >>> I am processing 23 GB file on 21 nodes. >>> >>> I have tried both options : >>> >>> mapreduce.job.reduces=50 >>> >>> & >>> >>> mapred.tasktracker.reduce.tasks.maximum=5 >>> in mapred-site.xml >>> >>> but still only one reducer is running. >>> >>> Any configuration setting still to be corrected? >>> >>> Thanks >>> Ravikant >>> >> > --089e011767f953649005196eeba7 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
set the value directly in code. Given a JobConf instance job, call 
job.setNumReduceTasks(100);

This worked for me

Thanks

On Fri, Jun 26,= 2015 at 9:07 PM, Ravikant Dindokar <ravikant.iisc@gmail.com>= wrote:
text file= with tab separated values

On Fri, Jun 26, = 2015 at 7:35 PM, Krishna Kalyan <krishnakalyan3@gmail.com> wrote:

What is the f= ile format?.

Thanks,
Krishna

On 26 Jun 2015 7:33 pm, "Ravikant Dindokar&= quot; <ravi= kant.iisc@gmail.com> wrote:
Hi Hadoo= p User,

I am processing 23 GB file on 21 nodes.

I= have tried both options :

mapreduce.job.reduces=3D50

& <= br>
mapred.tasktracker.reduce.tasks.maximum=3D5
in mapred-site.= xml

but still only one reducer is running.

Any co= nfiguration setting still to be corrected?

Thanks
Rav= ikant


--089e011767f953649005196eeba7--