hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From samir das mohapatra <samir.help...@gmail.com>
Subject Re: Right way to implement MR ?
Date Thu, 24 May 2012 18:19:09 GMT
Thanks
  Harsh J for your help.

On Thu, May 24, 2012 at 1:24 AM, Harsh J <harsh@cloudera.com> wrote:

> Samir,
>
> You can use MultipleInputs for multiple forms of inputs per mapper
> (with their own input K/V types, but common output K/V types) with a
> common reduce-side join/compare.
>
> See
> http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapreduce/lib/input/MultipleInputs.html
> .
>
> On Thu, May 24, 2012 at 1:17 AM, samir das mohapatra
> <samir.helpdoc@gmail.com> wrote:
> > Hi All,
> >     How to compare to input file In M/R Job.
> >     let A Log file around 30GB
> >    and B Log file size is around 60 GB
> >
> >  I wanted to know how  i will  define <K,V> inside the mapper.
> >
> >  Thanks
> >  samir.
>
>
>
> --
> Harsh J
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message