Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C1BB6D0CB for ; Tue, 11 Sep 2012 11:44:28 +0000 (UTC) Received: (qmail 77433 invoked by uid 500); 11 Sep 2012 11:44:23 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 77315 invoked by uid 500); 11 Sep 2012 11:44:23 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 77305 invoked by uid 99); 11 Sep 2012 11:44:23 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:44:23 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bejoy.hadoop@gmail.com designates 209.85.223.176 as permitted sender) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:44:17 +0000 Received: by iecs9 with SMTP id s9so768144iec.35 for ; Tue, 11 Sep 2012 04:43:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=IBXdhWD13Hc/dvNLRQYaJJF8hwOuoQA/k9rlhEaVfy8=; b=Vld5AsOvFyT3euioPZHoAeUseFrVNrdhY/l6a6Eo+M243HlfnHvw0rv4aGGmVzo2+B Kcu5rfWw5wPHFg1cTATzubW6WsoG7OfdklZMmSE17IaKRKDx6Me6ze3tioselu+hgyDl j2iYCeUMG92RbTGjaffISmyyTowrfNXk6AEcu3RyGHMiqHUgA4pL9826y2XbxCW9diwK NbRYSWzkEBmHpG9ZUg346zEg/afMdHGGDmesJFCXxNObNKg+4gIvExyiEfDcSBDI0QXN zwYx+zB8orNkqf0PxIiMgCpUrREBOwyADwqpmlSZ161BAyDJwuiG8y4ZvNOOLzi9LW/B 2Vpw== MIME-Version: 1.0 Received: by 10.43.45.200 with SMTP id ul8mr21364346icb.36.1347363836848; Tue, 11 Sep 2012 04:43:56 -0700 (PDT) Received: by 10.64.68.169 with HTTP; Tue, 11 Sep 2012 04:43:56 -0700 (PDT) In-Reply-To: References: Date: Tue, 11 Sep 2012 17:13:56 +0530 Message-ID: Subject: Re: what's the default reducer number? From: Bejoy Ks To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec529972fe0eb5e04c96b9602 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec529972fe0eb5e04c96b9602 Content-Type: text/plain; charset=ISO-8859-1 Hi Lin The default values for all the properties are in core-default.xml hdfs-default.xml and mapred-default.xml Regards Bejoy KS On Tue, Sep 11, 2012 at 5:06 PM, Jason Yang wrote: > Hi, Bejoy > > Thanks for you reply. > > where could I find the default value of mapred.reduce.tasks ? I have > checked the core-site.xml, hdfs-site.xml and mapred-site.xml, but I haven't > found it. > > > 2012/9/11 Bejoy Ks > >> Hi Lin >> >> The default value for number of reducers is 1 >> >> mapred.reduce.tasks >> 1 >> >> It is not determined by data volume. You need to specify the number of >> reducers for your mapreduce jobs as per your data volume. >> >> Regards >> Bejoy KS >> >> On Tue, Sep 11, 2012 at 4:53 PM, Jason Yang wrote: >> >>> Hi, all >>> >>> I was wondering what's the default number of reducer if I don't set it >>> in configuration? >>> >>> Will it change dynamically according to the output volume of Mapper? >>> >>> -- >>> YANG, Lin >>> >>> >> > > > -- > YANG, Lin > > --bcaec529972fe0eb5e04c96b9602 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Lin

The default values for all the properties a= re in
core-default.xml
hdfs-default.xml and
mapred-= default.xml


Regards
Bejoy= KS


On Tue, Sep 11, 2012 at 5:06 PM, Ja= son Yang <lin.yang.jason@gmail.com> wrote:
Hi, Bejoy

Thanks for you reply.

where could I find the default value of mapred.reduce.tasks ? I have check= ed the core-site.xml, hdfs-site.xml and mapred-site.xml, but I haven't = found it.


2012/9/11 Bejoy Ks <bejoy.hadoop@gmail= .com>
Hi Lin

The default value for number of reducers is 1

<name>mapred.reduce.tasks</name>
=A0 <value>1</value>

It is not = determined by data volume. You need to specify the number of reducers for y= our mapreduce jobs as per your data volume.

Regards
Bejoy K= S

On Tue, Sep 1= 1, 2012 at 4:53 PM, Jason Yang <lin.yang.jason@gmail.com> wrote:
Hi, all

I was wondering w= hat's the default number of reducer if I don't set it in configurat= ion?

Will it change dynamically according to the output volu= me of Mapper?

--
YANG, Lin





--
YANG, Lin


--bcaec529972fe0eb5e04c96b9602--