hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Enis Soztutar <enis.soz.nu...@gmail.com>
Subject Re: How to run Map/Reduce for iterative algorithms in Hadoop?
Date Tue, 21 Aug 2007 07:56:09 GMT
Yes you can.

If the job you are iterating is the same, then just put the job 
submission in a loop. For example :

for(int i=0;i<something;i++) {
  if(isDone())
    break;

  JobConf job = new JobConf(conf);
  job.addInputPath("foo");
  job.setOutputPath("bar");
  //set job parameters accordingly
  JobClient.runJob(job);
}



ChaoChun Liang wrote:
> Hello:
>
> According the Map/Reduce working flow, it runs map first, then reduce.
> Could I run this pairs for several iterations(i.e. to run map/reduce several
> times
> and stop for certain criteria, like some iterative methods in
> numerical-analysis)? 
> If the answer is yes, any example to do that?
>
> ---ChaoChun
>
>   

Mime
View raw message