Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of redpony@gmail.com designates
 74.125.92.26 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=message-id:date:from:sender:to:subject:in-reply-to:mime-version
         :content-type:content-transfer-encoding:content-disposition
         :references:x-google-sender-auth;
        b=WDaDGZxv2Dgiwb1vO5z3czuIyvsSW+DYDzjXpEKuBEBPFpUoey3YeJWaCIBEAdTySo
         Vh4kaAU823q4ehalYvvSuJn3xzPD5Yj74jiAthx3gUXyTLetPdGY+Cslnrjp/Qam1WPr
         fRSY2pfM5p4dpQ/KdSf7WH80Ga1cWlRPHc1Dk=
Message-ID: <a763284c0812072329y645b1438o1140ea9f2702fc2e@mail.gmail.com>
Date: Mon, 8 Dec 2008 02:29:44 -0500
From: "Chris Dyer" <redpony@umd.edu>
Sender: redpony@gmail.com
To: core-user@hadoop.apache.org
Subject: Re: Run Map-Reduce multiple times
In-Reply-To: <da9a0cdf0812072225v4edb6e3al107c462df62fd69c@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
References: <da9a0cdf0812072225v4edb6e3al107c462df62fd69c@mail.gmail.com>

Hey Delip-
mapreduce doesn't really have any particular support for iterative
algorithms.  You just have to put a loop in the control program and
set the output path from the previous iteration to be the input path
in the next iteration.  This at least lets you control whether you
decide to keep around results of intermediate iterations or erase
them...
-Chris

On Mon, Dec 8, 2008 at 1:25 AM, Delip Rao <deliprao@gmail.com> wrote:
> Hi,
>
> I need to run my map-reduce routines for several iterations so that
> the output of an iteration becomes the input to the next iteration. Is
> there a standard pattern to do this instead of calling
> JobClient.runJob() in a loop?
>
> Thanks,
> Delip
>