hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: output from one map reduce job as the input to another map reduce job?
Date Tue, 27 Sep 2011 19:45:29 GMT

On Sep 27, 2011, at 12:09 PM, Kevin Burton wrote:

> Is it possible to connect the output of one map reduce job so that it is the input to
another map reduce job.
> 
> Basically… then reduce() outputs a key, that will be passed to another map() function
without having to store intermediate data to the filesystem.
> 

Currently there is no way to pipeline in such a manner - with hadoop-0.23 it's doable, but
will take more effort.

Arun


Mime
View raw message