Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 433AFD052 for ; Tue, 11 Sep 2012 11:37:25 +0000 (UTC) Received: (qmail 42982 invoked by uid 500); 11 Sep 2012 11:37:20 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 42714 invoked by uid 500); 11 Sep 2012 11:37:16 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 42697 invoked by uid 99); 11 Sep 2012 11:37:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:37:15 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of lin.yang.jason@gmail.com designates 209.85.223.176 as permitted sender) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:37:09 +0000 Received: by iecs9 with SMTP id s9so756066iec.35 for ; Tue, 11 Sep 2012 04:36:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=+9r6RPCd88Sa5qhgbt6PcZLEXGNVHJ+rx6gzH0ZmaBs=; b=xV8ge+O+G2wdO+xfYJFs9Kk39tz7qmMfqXUIN90wq64UBmTnLNm+m3rzJ5UV3J3u4+ NwPdbHy/WYuABbmH4sHyv+bbHOSU6j0Ik8PErkl/SOWRB9eqykKctiiogY+NSKuYXoZ0 i2J9J12gqq8S4hMxgslVNTDK4/po1mxlVgiTTyXJCIfMY+0N1IG1C6oGmLoFCCXvvfFQ KkAUl/nQ0Bkb9ksblHcjs1eUDzz8PNMpOhmeQ4xw4RXenrU0h56YktO54SRuFv6l8exB nnTSUJ/PoiZ1it0R3LoSrcPm8gZjmRDtDGrSC944whzOziGJXrOY+O/oFf+rE8D/dzF7 /Dqw== Received: by 10.50.94.201 with SMTP id de9mr16096081igb.61.1347363408752; Tue, 11 Sep 2012 04:36:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.43.48.195 with HTTP; Tue, 11 Sep 2012 04:36:28 -0700 (PDT) In-Reply-To: References: From: Jason Yang Date: Tue, 11 Sep 2012 19:36:28 +0800 Message-ID: Subject: Re: what's the default reducer number? To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8f2343eb5cb04204c96b7d91 X-Virus-Checked: Checked by ClamAV on apache.org --e89a8f2343eb5cb04204c96b7d91 Content-Type: text/plain; charset=ISO-8859-1 Hi, Bejoy Thanks for you reply. where could I find the default value of mapred.reduce.tasks ? I have checked the core-site.xml, hdfs-site.xml and mapred-site.xml, but I haven't found it. 2012/9/11 Bejoy Ks > Hi Lin > > The default value for number of reducers is 1 > > mapred.reduce.tasks > 1 > > It is not determined by data volume. You need to specify the number of > reducers for your mapreduce jobs as per your data volume. > > Regards > Bejoy KS > > On Tue, Sep 11, 2012 at 4:53 PM, Jason Yang wrote: > >> Hi, all >> >> I was wondering what's the default number of reducer if I don't set it in >> configuration? >> >> Will it change dynamically according to the output volume of Mapper? >> >> -- >> YANG, Lin >> >> > -- YANG, Lin --e89a8f2343eb5cb04204c96b7d91 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi, Bejoy

Thanks for you reply.

where could I find the default value of mapred.reduce.tasks ? I have check= ed the core-site.xml, hdfs-site.xml and mapred-site.xml, but I haven't = found it.

2012/9/11 Bejoy Ks <bejoy.hadoop@gmail= .com>
Hi Lin

The default value for number of reducers is 1

<name>mapred.reduce.tasks</name>
=A0 <value>1</value>

It is not = determined by data volume. You need to specify the number of reducers for y= our mapreduce jobs as per your data volume.

Regards
Bejoy KS

On Tue, Sep 11, 2012 at 4:53 PM, Jason Yang <lin.y= ang.jason@gmail.com> wrote:
Hi, all

I was wondering w= hat's the default number of reducer if I don't set it in configurat= ion?

Will it change dynamically according to the output volu= me of Mapper?

--
YANG, Lin





--
YANG, L= in

--e89a8f2343eb5cb04204c96b7d91--