Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 10923 invoked from network); 29 Dec 2010 06:47:55 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 29 Dec 2010 06:47:55 -0000 Received: (qmail 68908 invoked by uid 500); 29 Dec 2010 06:47:52 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 68686 invoked by uid 500); 29 Dec 2010 06:47:52 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 68675 invoked by uid 99); 29 Dec 2010 06:47:52 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Dec 2010 06:47:52 +0000 X-ASF-Spam-Status: No, hits=2.2 required=10.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: local policy) Received: from [209.85.216.169] (HELO mail-qy0-f169.google.com) (209.85.216.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 29 Dec 2010 06:47:45 +0000 Received: by qyk7 with SMTP id 7so10908553qyk.14 for ; Tue, 28 Dec 2010 22:47:24 -0800 (PST) Received: by 10.224.53.213 with SMTP id n21mr13636974qag.399.1293605243902; Tue, 28 Dec 2010 22:47:23 -0800 (PST) MIME-Version: 1.0 Received: by 10.220.190.75 with HTTP; Tue, 28 Dec 2010 22:47:03 -0800 (PST) X-Originating-IP: [67.160.196.149] In-Reply-To: References: <-5376796593403073256@unknownmsgid> From: Ted Dunning Date: Tue, 28 Dec 2010 22:47:03 -0800 Message-ID: Subject: Re: help for using mapreduce to run different code? To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=0015175cb8d20adbc3049886f17c X-Virus-Checked: Checked by ClamAV on apache.org --0015175cb8d20adbc3049886f17c Content-Type: text/plain; charset=ISO-8859-1 Also take a look at the optimizations as done in this paper: http://www.deepdyve.com/lp/association-for-computing-machinery/flumejava-easy-efficient-data-parallel-pipelines-wwPgFt2hWB On Tue, Dec 28, 2010 at 9:13 PM, Harsh J wrote: > Have a look at MultipleInputs > > On Wed, Dec 29, 2010 at 4:39 AM, Jander g wrote: > > Hi James, > > > > Thanks for your attention. > > > > Suppose there are only 2 map running in Hadoop cluster, I want to using > one > > map to sort and another to wordcount in the same time in the same Hadoop > > cluster. > > > > On Wed, Dec 29, 2010 at 6:58 AM, James Seigel wrote: > > > >> Not sure what you mean. > >> > >> Can you write custom code for your map functions?: yes > >> > >> Cheers > >> James > >> > >> Sent from my mobile. Please excuse the typos. > >> > >> On 2010-12-28, at 3:54 PM, Jander g wrote: > >> > >> > Hi, all > >> > > >> > Whether Hadoop supports the map function running different code? If > yes, > >> how > >> > to realize this? > >> > > >> > Thanks in advance! > >> > > >> > -- > >> > Regards, > >> > Jander > >> > > > > > > > > -- > > Thanks, > > Jander > > > > > > -- > Harsh J > www.harshj.com > --0015175cb8d20adbc3049886f17c--