hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Delip Rao" <delip...@gmail.com>
Subject Re: Run Map-Reduce multiple times
Date Mon, 08 Dec 2008 07:47:12 GMT
Thanks Chris! I ended up doing something similar too.

On Mon, Dec 8, 2008 at 2:29 AM, Chris Dyer <redpony@umd.edu> wrote:
> Hey Delip-
> mapreduce doesn't really have any particular support for iterative
> algorithms.  You just have to put a loop in the control program and
> set the output path from the previous iteration to be the input path
> in the next iteration.  This at least lets you control whether you
> decide to keep around results of intermediate iterations or erase
> them...
> -Chris
>
> On Mon, Dec 8, 2008 at 1:25 AM, Delip Rao <deliprao@gmail.com> wrote:
>> Hi,
>>
>> I need to run my map-reduce routines for several iterations so that
>> the output of an iteration becomes the input to the next iteration. Is
>> there a standard pattern to do this instead of calling
>> JobClient.runJob() in a loop?
>>
>> Thanks,
>> Delip
>>
>

Mime
View raw message