hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Douglas <cdoug...@apache.org>
Subject Re: Hadoop map-side join
Date Wed, 14 Nov 2012 17:42:52 GMT
See https://issues.apache.org/jira/browse/MAPREDUCE-355 (not in 1.x series) -C

On Tue, Nov 13, 2012 at 8:26 AM, Guang Yang <gyang@millennialmedia.com> wrote:
> Hi,
>
> I'm trying to use Hadoop map-side join in my application and wondering if
> anybody knows if there's a way to use it with the new Hadoop API
> ("org.apache.hadoop.mapreduce.*") instead of the old Hadoop API
> ("org.apache.hadoop.mapred.*"). The input format I'm trying to use for the
> join is "CompositeInputFormat", which is in the old API package and looks
> like it expects everything (job configuration, input split, etc) to be from
> the old API too. This is a problem for me because I'm using the new API to
> create my map/reduce jobs so I can't just use "CompositeInputFormat" as my
> job's input format. I wonder if the only way to get the map-side join work
> is to use the old API to create map/reduce jobs. I appreciate any response
> regarding this issue.
>
> Thanks,
> Guang Yang

Mime
View raw message