hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bertrand Dechoux <decho...@gmail.com>
Subject Re: Collecting MAP output in a Iterator
Date Mon, 20 Aug 2012 20:28:50 GMT
The question is why do you want to do that? How will you use the output?
You really want a cross join? This a very expensive operation (in terms of
memory).

Could you provide more context?

Regards

Bertrand

On Mon, Aug 20, 2012 at 10:24 PM, Lance Norskog <goksron@gmail.com> wrote:

> The reducer has to open MAP2 explicitly. If it is a regular file, it
> has to be in distributed cache.
>
> On Mon, Aug 20, 2012 at 12:56 PM, Siddharth Tiwari
> <siddharth.tiwari@live.com> wrote:
> >
> > Hi
> >
> > I have two mappers MAP1 and MAP2, which collect data from two different
> > files,
> > In reducer I want to traverse all keys and values of MAP2 for each key
> and
> > value of  MAP1.
> > How can I achieve it in one Reducer.
> >
> > Please suggest
> >
> >
> > *------------------------*
> > Cheers !!!
> > Siddharth Tiwari
> > Have a refreshing day !!!
> > "Every duty is holy, and devotion to duty is the highest form of worship
> of
> > God.”
> > "Maybe other people will try to limit me but I don't limit myself"
>
>
>
> --
> Lance Norskog
> goksron@gmail.com
>



-- 
Bertrand Dechoux

Mime
View raw message