hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From abc xyz <fabc_xyz...@yahoo.com>
Subject Re: Chaining Map-Reduce
Date Fri, 02 Jul 2010 08:14:38 GMT
one option can be to use multiple chained jobs using JobControl object. 
But can anyone tell whether in this case the output of first job be written to 
the disk? Actually I want to minimize access to the disk.

Cheers



________________________________
From: Fariha Atta <fariha.atta.pk@gmail.com>
To: general@hadoop.apache.org
Sent: Fri, July 2, 2010 8:45:12 AM
Subject: Re: Chaining Map-Reduce

But it provides chaining like Map+ | Reduce | Map* i.e. we can use only one
reducer.


On Fri, Jul 2, 2010 at 8:37 AM, Venkatesh S <svenkat@yahoo-inc.com> wrote:

> You could use ChainMapper and ChainReducer API in hadoop.
>



      
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message