Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 10FCBD017 for ; Tue, 11 Sep 2012 11:31:31 +0000 (UTC) Received: (qmail 25340 invoked by uid 500); 11 Sep 2012 11:31:25 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 25223 invoked by uid 500); 11 Sep 2012 11:31:25 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 25038 invoked by uid 99); 11 Sep 2012 11:31:24 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:31:24 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of bejoy.hadoop@gmail.com designates 209.85.223.176 as permitted sender) Received: from [209.85.223.176] (HELO mail-ie0-f176.google.com) (209.85.223.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Sep 2012 11:31:18 +0000 Received: by iecs9 with SMTP id s9so746007iec.35 for ; Tue, 11 Sep 2012 04:30:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=mW2oaPTyzWds/4dTvD1k3aAqz0lgncI3+WBdmF0x0sA=; b=ddqM9BV9xuISo8Zn9thstOOSXd7iIr71TtxRpD6lutiIeZEpCMESyBhYZd/zl9fH+a 2BR6LdFiZO4Fu9gkV0L0yhvZYp7FP+euOzpzO/RXWTj7h+whNAvEaAbXNnNWY20ukhXx 07pZ1+6SC61+lrLzNygnzX2fftdwIrrSybW3i0F2z7yJBnEBg70Z4jf1/KUevXtv7VVy l7gYncE9B5YqX6R9wXvr4Ec1Wywf6yyw0YUKBv2AcPLDuaAchBnkGrMoU670mIssqBB4 w7U4S6zvVM1YwhWLz/MUcQyyaz5rXVwazZ0OFqlfCO9WIBWC9kFhALhTocNFhsb69YTK Tz1A== MIME-Version: 1.0 Received: by 10.50.202.4 with SMTP id ke4mr16467665igc.72.1347363057533; Tue, 11 Sep 2012 04:30:57 -0700 (PDT) Received: by 10.64.68.169 with HTTP; Tue, 11 Sep 2012 04:30:57 -0700 (PDT) In-Reply-To: References: Date: Tue, 11 Sep 2012 17:00:57 +0530 Message-ID: Subject: Re: what's the default reducer number? From: Bejoy Ks To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=f46d044788436d849604c96b68e5 X-Virus-Checked: Checked by ClamAV on apache.org --f46d044788436d849604c96b68e5 Content-Type: text/plain; charset=ISO-8859-1 Hi Lin The default value for number of reducers is 1 mapred.reduce.tasks 1 It is not determined by data volume. You need to specify the number of reducers for your mapreduce jobs as per your data volume. Regards Bejoy KS On Tue, Sep 11, 2012 at 4:53 PM, Jason Yang wrote: > Hi, all > > I was wondering what's the default number of reducer if I don't set it in > configuration? > > Will it change dynamically according to the output volume of Mapper? > > -- > YANG, Lin > > --f46d044788436d849604c96b68e5 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi Lin

The default value for number of reducers is 1

<name>mapred.reduce.tasks</name>
=A0 <value>1</value>

It is not = determined by data volume. You need to specify the number of reducers for y= our mapreduce jobs as per your data volume.

Regards
Bejoy KS

On Tue, Sep 11, 2012 at 4:53 PM, Jason Yang <<= a href=3D"mailto:lin.yang.jason@gmail.com" target=3D"_blank">lin.yang.jason= @gmail.com> wrote:
Hi, all

I was wondering w= hat's the default number of reducer if I don't set it in configurat= ion?

Will it change dynamically according to the output volu= me of Mapper?

--
YANG, Lin


--f46d044788436d849604c96b68e5--