hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhou, Yunqing" <azure...@gmail.com>
Subject Re: Multiple Input Data Processing using MapReduce
Date Fri, 31 Dec 2010 12:47:17 GMT
You can use "map.input.split"(something like that, I can't remember..) param
in Configuration.
this param contains the input file path, you can use it to branch your logic
this param can be found in TextInputFormat.java

On Thu, Oct 14, 2010 at 10:03 PM, Matthew John
<tmatthewjohn1988@gmail.com>wrote:

> Hi all ,
>
>  I have been recently working on a task where I need to take in two input
> (types)  files , compare them and produce a result from it using a logic.
> But as I understand simple MapReduce implementations are for processing a
> single input type. The closest implementation I could think of similar to
> my
> work is Join MapReduce. But I am not able to understand much from the
> example provided in Hadoop .. Can someone provide a good pointer to such
> multiple input data processing ( or Join ) in mapreduce . It will also be
> great if you can send in some sample code for the same.
>
> Thanks ,
>
> Matthew
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message