hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jesper Utoft <jesper.ut...@gmail.com>
Subject Re: how to implement post-mapper processing
Date Wed, 25 Aug 2010 14:10:04 GMT
Hello.
I do not know if i get this right.
But you have some files you split. Then want to process those.

Could a job with multiple mappers and a single reducer do a thing like this?

Cheers
Jesper

2010/8/25 Anfernee Xu <anfernee.xu@gmail.com>

> Hi Ken,
>
> Thanks for your reply, but I do not think chainmapper is helperful for me,
> since the next mapper will process the current record(key/value pair)
> produced by current mapper in the chain, but I want the next mapper shoud
> run only after all records and all splits are processed.
>
> Anfernee
>
> On Wed, Aug 25, 2010 at 9:25 PM, Ken Goodhope <kengoodhope@gmail.com>wrote:
>
>> Look into chainmapper. Sounds like it might satisfy your needs.
>>
>
>
>
> --
> --Anfernee
>

Mime
View raw message