Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B52EADBD8 for ; Tue, 13 Nov 2012 16:26:41 +0000 (UTC) Received: (qmail 81766 invoked by uid 500); 13 Nov 2012 16:26:37 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 81344 invoked by uid 500); 13 Nov 2012 16:26:36 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 81312 invoked by uid 99); 13 Nov 2012 16:26:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Nov 2012 16:26:35 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gyang@millennialmedia.com designates 206.225.164.218 as permitted sender) Received: from [206.225.164.218] (HELO hub021-nj-3.exch021.serverdata.net) (206.225.164.218) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 13 Nov 2012 16:26:26 +0000 Received: from MBX021-E3-NJ-2.exch021.domain.local ([10.240.4.78]) by HUB021-NJ-3.exch021.domain.local ([10.240.4.36]) with mapi id 14.02.0318.001; Tue, 13 Nov 2012 08:26:05 -0800 From: Guang Yang To: "user@hadoop.apache.org" CC: Peter Sheridan , Jim Brooks Subject: Hadoop map-side join Thread-Topic: Hadoop map-side join Thread-Index: AQHNwbuRGifTju/vyEylL+1ehr7FbA== Date: Tue, 13 Nov 2012 16:26:05 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [38.118.54.10] Content-Type: multipart/alternative; boundary="_000_A8B921227BEEA7429E36512A6D1A259E17CC5AF6MBX021E3NJ2exch_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_A8B921227BEEA7429E36512A6D1A259E17CC5AF6MBX021E3NJ2exch_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I'm trying to use Hadoop map-side join in my application and wondering if a= nybody knows if there's a way to use it with the new Hadoop API ("org.apach= e.hadoop.mapreduce.*") instead of the old Hadoop API ("org.apache.hadoop.ma= pred.*"). The input format I'm trying to use for the join is "CompositeInpu= tFormat", which is in the old API package and looks like it expects everyth= ing (job configuration, input split, etc) to be from the old API too. This = is a problem for me because I'm using the new API to create my map/reduce j= obs so I can't just use "CompositeInputFormat" as my job's input format. I = wonder if the only way to get the map-side join work is to use the old API = to create map/reduce jobs. I appreciate any response regarding this issue. Thanks, Guang Yang --_000_A8B921227BEEA7429E36512A6D1A259E17CC5AF6MBX021E3NJ2exch_ Content-Type: text/html; charset="us-ascii" Content-ID: <470EE14DFE1367418FF04496F05DA487@exch021.domain.local> Content-Transfer-Encoding: quoted-printable
Hi,

I'm trying to use Hadoop map-side join in my application and wondering= if anybody knows if there's a way to use it with the new Hadoop API ("= ;org.apache.hadoop.m= apreduce.*") instead of the old Hadoop API ("o= rg.apache.hadoop.mapred.*"). The input format I'm trying t= o use for the join is "CompositeInputFormat", which is in the old= API package and looks like it expects everything (job configuration, input split, etc) to be from the old API too. This is a problem for me bec= ause I'm using the new API to create my map/reduce jobs so I can't just use=  "CompositeInputFormat" as my job's input format. I wonder i= f the only way to get the map-side join work is to use the old API to create map/reduce jobs. I appreciate any response re= garding this issue. 

Thanks,
Guang Yang
--_000_A8B921227BEEA7429E36512A6D1A259E17CC5AF6MBX021E3NJ2exch_--