Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EF46710EF0 for ; Fri, 7 Jun 2013 11:18:23 +0000 (UTC) Received: (qmail 97845 invoked by uid 500); 7 Jun 2013 11:18:18 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 97438 invoked by uid 500); 7 Jun 2013 11:18:09 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 97314 invoked by uid 99); 7 Jun 2013 11:18:08 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 07 Jun 2013 11:18:08 +0000 X-ASF-Spam-Status: No, hits=4.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_BL_SPAMCOP_NET,RCVD_IN_DNSWL_NONE X-Spam-Check-By: apache.org Received-SPF: error (nike.apache.org: local policy) Received: from [106.10.148.227] (HELO nm10-vm4.bullet.mail.sg3.yahoo.com) (106.10.148.227) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 07 Jun 2013 11:18:00 +0000 Received: from [106.10.166.112] by nm10.bullet.mail.sg3.yahoo.com with NNFMP; 07 Jun 2013 11:17:16 -0000 Received: from [106.10.151.171] by tm1.bullet.mail.sg3.yahoo.com with NNFMP; 07 Jun 2013 11:17:16 -0000 Received: from [127.0.0.1] by omp1011.mail.sg3.yahoo.com with NNFMP; 07 Jun 2013 11:17:16 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 773924.41362.bm@omp1011.mail.sg3.yahoo.com Received: (qmail 65688 invoked by uid 60001); 7 Jun 2013 11:17:16 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.in; s=s1024; t=1370603836; bh=T2PI9JBiqfYT9Hcs+4Cw82pQeyJ0z27PAuLSwa4obgc=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=ydIcVcl/MchyBqdudyth9R9V/2jLTa+7h30vWkmNFrflulDhJf2MI5APAvnF5LICRZnvAIWyHvWIM9yIqsneLsI+GOou6fbf/Z7ZBlTSkutArFV8Ts8oimzxgY7NGPG6qZQbyRHvBhilyiSyYnuln7nOQxaKBXgOJy5mdgxSeZ0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.in; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=J3hhRkKjrGX0+1ycowJlfKvbKfN9vj0/H5oWu8DnIJ4SSsBLwmSqBT/L8SouR3yRV+O2pQOB0Pf3g0gtlM96gQQ1fPGrpOSLRxDMWOTSZZzYKjO7Nn1CLqP2bmlZuPW3Zn9zk4UQNf9Dk0EKtFVZdr1JY/+S6mwA9QdTWQaQ0SU=; X-YMail-OSG: d0mq7fQVM1lhBbnpN9EBYaJVm5yTnRueVDy2H4WdTVfPBWU hB1kcQu4uoRwc5wkKOJrMYeX_Zt57Kbw73x.cyoGi.BR8vILWCb02SSrLk_v 3zNJnQYvwoWeXs4Ug1s0HMjsXQVvGNMMd1D0vwBNipwr2IXTSpULnqvsmAwi NAh53V2VqyqSAOLAC8yywDfI6imka.8VzY16z10DbIkUEzGps_3F_Uj7An8w lcnHRMZN4jJn7knillnrt0zlZh70t1kLF0e8_5j75X0xt8BUL8_W1V1gVDih Ixlbx8XFHCv9IOXbfrU4o_Vdh9tAfhYKL4bGCsmdfdC.z6.MFYRT35V10Lkp CY8.hG4jE76SGC50KPtKby2luGG81w4VIMn_0AgZ8gsDlcTZW9WqIS1vmG0K 4cJL9TK3iSAhl7S.msz4kbNzVy217SRVf5z4WytqGBPbhZXMQw6_Ko.2nVyb 4qK1MtdNcyAxZi7us5A-- Received: from [49.204.34.131] by web190704.mail.sg3.yahoo.com via HTTP; Fri, 07 Jun 2013 19:17:16 SGT X-Rocket-MIMEInfo: 002.001,SSBhbHdheXMgZ2V0IGNvbmZ1c2VkIHdoeSB3ZSBzaG91bGQgcGFydGl0aW9uIGFuZCB3aGF0IGlzIHRoZSB1c2Ugb2YgaXQuCldoeSB3b3VsZCBvbmUgd2FudCB0byBzZW5kIGFsbCB0aGUga2V5cyBzdGFydGluZyB3aXRoIEEgdG8gUmVkdWNlcjEgYW5kIEIgdG8gUjIgYW5kIHNvIG9uLi4uCklzIGl0IGp1c3QgdG8gcGFyYWxsZWxpemUgdGhlIHJlZHVjZSBwcm9jZXNzLgpQbGVhc2UgaGVscC4KVGhhbmtzClNhaQEwAQEBAQ-- X-Mailer: YahooMailWebService/0.8.145.547 References: <1369191774.59557.YahooMailNeo@web190702.mail.sg3.yahoo.com> Message-ID: <1370603836.37168.YahooMailNeo@web190704.mail.sg3.yahoo.com> Date: Fri, 7 Jun 2013 19:17:16 +0800 (SGT) From: Sai Sai Reply-To: Sai Sai Subject: Re: Why/When partitioner is used. To: "user@hadoop.apache.org" In-Reply-To: <1369191774.59557.YahooMailNeo@web190702.mail.sg3.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-929976460-962295032-1370603836=:37168" X-Virus-Checked: Checked by ClamAV on apache.org ---929976460-962295032-1370603836=:37168 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I always get confused why we should partition and what is the use of it.=0A= Why would one want to send all the keys starting with A to Reducer1 and B t= o R2 and so on...=0AIs it just to parallelize the reduce process.=0APlease = help.=0AThanks=0ASai ---929976460-962295032-1370603836=:37168 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
I always get con= fused why we should partition and what is the use of it.
Why woul= d one want to send all the keys starting with A to Reducer1 and B to R2 and= so on...
Is it just to parallelize the reduce process.
Please help.
Thanks
Sai
---929976460-962295032-1370603836=:37168--