hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Dyer" <redp...@umd.edu>
Subject Re: Run Map-Reduce multiple times
Date Mon, 08 Dec 2008 07:29:44 GMT
Hey Delip-
mapreduce doesn't really have any particular support for iterative
algorithms.  You just have to put a loop in the control program and
set the output path from the previous iteration to be the input path
in the next iteration.  This at least lets you control whether you
decide to keep around results of intermediate iterations or erase

On Mon, Dec 8, 2008 at 1:25 AM, Delip Rao <deliprao@gmail.com> wrote:
> Hi,
> I need to run my map-reduce routines for several iterations so that
> the output of an iteration becomes the input to the next iteration. Is
> there a standard pattern to do this instead of calling
> JobClient.runJob() in a loop?
> Thanks,
> Delip

View raw message