Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9AD97C6E9 for ; Sun, 16 Jun 2013 19:03:00 +0000 (UTC) Received: (qmail 50518 invoked by uid 500); 16 Jun 2013 19:02:55 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 50411 invoked by uid 500); 16 Jun 2013 19:02:54 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 50404 invoked by uid 99); 16 Jun 2013 19:02:54 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 16 Jun 2013 19:02:54 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of john.lilley@redpoint.net designates 206.225.164.223 as permitted sender) Received: from [206.225.164.223] (HELO hub021-nj-7.exch021.serverdata.net) (206.225.164.223) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 16 Jun 2013 19:02:47 +0000 Received: from MBX021-E3-NJ-2.exch021.domain.local ([10.240.4.78]) by HUB021-NJ-7.exch021.domain.local ([10.240.4.114]) with mapi id 14.03.0123.003; Sun, 16 Jun 2013 12:02:25 -0700 From: John Lilley To: "user@hadoop.apache.org" Subject: RE: how to design the mapper and reducer for the below problem Thread-Topic: how to design the mapper and reducer for the below problem Thread-Index: AQHOaLmVu2dZ2eHpE0G/8croMjRaqZk4tCmg Date: Sun, 16 Jun 2013 19:02:25 +0000 Message-ID: <869970D71E26D7498BDAC4E1CA92226B658C6EFF@MBX021-E3-NJ-2.exch021.domain.local> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [173.160.43.61] Content-Type: multipart/alternative; boundary="_000_869970D71E26D7498BDAC4E1CA92226B658C6EFFMBX021E3NJ2exch_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_869970D71E26D7498BDAC4E1CA92226B658C6EFFMBX021E3NJ2exch_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I don't think can be done in a single map/reduce pass. Here the author discusses an implementation in PIG: http://techblug.wordpre= ss.com/2011/08/07/transitive-closure-in-pig/ john From: parnab kumar [mailto:parnab.2007@gmail.com] Sent: Thursday, June 13, 2013 10:42 PM To: user@hadoop.apache.org Subject: how to design the mapper and reducer for the below problem Consider a following input file of format : input File : 1 2 2 3 3 4 6 7 7 9 10 11 The output Should be as follows : 1 2 3 4 6 7 9 10 11 --_000_869970D71E26D7498BDAC4E1CA92226B658C6EFFMBX021E3NJ2exch_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

I don’t think can b= e done in a single map/reduce pass.

Here the author discusses= an implementation in PIG: http://techblug.wordpress.com/2011/08/07/transitive-closure-in-= pig/

john

 <= /p>

From: parnab k= umar [mailto:parnab.2007@gmail.com]
Sent: Thursday, June 13, 2013 10:42 PM
To: user@hadoop.apache.org
Subject: how to design the mapper and reducer for the below problem<= o:p>

 

Consider a following= input file of format :
input File :
1 2
2 3
3 4
6 7
7 9
10 11

The output Should be as follows :
1 2 3 4 
6 7 9
10 11

--_000_869970D71E26D7498BDAC4E1CA92226B658C6EFFMBX021E3NJ2exch_--