Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1894FD79A for ; Sun, 23 Sep 2012 03:54:22 +0000 (UTC) Received: (qmail 66139 invoked by uid 500); 23 Sep 2012 03:54:17 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 65778 invoked by uid 500); 23 Sep 2012 03:54:17 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 65757 invoked by uid 99); 23 Sep 2012 03:54:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 23 Sep 2012 03:54:16 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FSL_RCVD_USER,HTML_IMAGE_ONLY_28,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_REMOTE_IMAGE X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dechouxb@gmail.com designates 209.85.216.176 as permitted sender) Received: from [209.85.216.176] (HELO mail-qc0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 23 Sep 2012 03:54:08 +0000 Received: by qcon41 with SMTP id n41so1428201qco.35 for ; Sat, 22 Sep 2012 20:53:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ZNq5wECGHv7atwdrJzipv3N/q0o6zyb9SvZMGgW8Po8=; b=BN/W0EEoSfsnl3QkbmjUtYcO998JSPCsZ1DY87rhXUnmUDTmzHH6GQiroOyeEECMTE m+UMnf2W3fgRe8cCdb1DmdHrnha+KUDPJrgjloTLxOvXoQFIEGbGm1gbl6s4n0xZzRow ndj6WF4hYJpKZEyHRJpmmW3aRL9kVaewN16ruo5++EFEbKGOnhnfrrn0gQGczsLyuQYA I2q4nKxC47gPiXhttsHbRyoAWd/WgSuWjzyUU/02hz9KpN4rjzewdTTk152Rpd7RcF8q 4IMnsFKGXAA+NGMsWvTXqTdvIggSIYkrs+sZQ96eSVe5KrAH1Cw9XwWB4+ULmhfXLya4 jWBg== MIME-Version: 1.0 Received: by 10.224.107.2 with SMTP id z2mr23139942qao.71.1348372427263; Sat, 22 Sep 2012 20:53:47 -0700 (PDT) Received: by 10.49.71.231 with HTTP; Sat, 22 Sep 2012 20:53:47 -0700 (PDT) In-Reply-To: References: Date: Sun, 23 Sep 2012 05:53:47 +0200 Message-ID: Subject: Re: How to set 2mappers on 1 job From: Bertrand Dechoux To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=20cf3074b2bc8d507404ca566b08 --20cf3074b2bc8d507404ca566b08 Content-Type: text/plain; charset=ISO-8859-1 You can use the map.input.file property to decide which logic should your mapper apply. Regards Bertrand On Sun, Sep 23, 2012 at 5:40 AM, kumudu harshani wrote: > Hi... > Could someone help me with following scenario.. > > I want implement a job which should get 2 mapper outputs and send them to > 1 reducer. Attached image show the flow I wanted.... > > > > > Normal flow is like: > > JobConf conf2 = new JobConf(WordCount.class); > Job job2 = new Job(conf2); > conf2.setOutputKeyClass(IntWritable.class); > conf2.setOutputValueClass(Text.class); > > conf2.setMapperClass(Map1.class); > conf2.setReducerClass(Reduce1.class); > > --- where it takes 1 mapper and 1 reducer. What i want is to set 2 > maps(mapper1a, mapper1b) and 1 reducer... > Is that possible, if so could someone please help.. > > thanks > kumudu > -- > > *Kumudu Samarappuli* | Creative Search Technologies, a Microsoft IEG > Partner | Software Engineer I | m: +94 719 258 242 | > www.microsoft.com/enterprisesearch > > -- Bertrand Dechoux --20cf3074b2bc8d507404ca566b08 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable You can use the=A0map.input.file property to decide which logic should your= mapper apply.
Regards
Bertrand

On Sun, Sep 23, 2012 at 5:40 AM, kumudu harshani <= ;kumuduharsha= ni@gmail.com> wrote:
Hi...
Could someone help me with followin= g scenario..

I want implement a job which should get 2 mapper output= s and send them to 1 reducer. Attached image show the flow I wanted....

3D""


Normal flow is like:

JobC= onf conf2 =3D new JobConf(WordCount.class);
Job job2 =3D new Job(conf2);=
conf2.setOutputKeyClass(IntWritable.class);
conf2.setOutputValueClas= s(Text.class);

conf2.setMapperClass(Map1.class);
conf2.setReducerClass(Reduce1.clas= s);


--- where it takes 1 mapper and 1 reducer. What i want is= to set 2 maps(mapper1a, mapper1b) and 1 reducer...
Is that possible, i= f so could someone please help..

thanks
kumudu
-- =

= Kumudu Samarappuli | Creati= ve Search Technologies, a Microsoft IEG Partner | Software Engineer I | m: +94 719 258 242 | www.microsof= t.com/enterprisesearch





-- Bertrand Dechoux
--20cf3074b2bc8d507404ca566b08--