hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "晋光峰" <jinguangf...@gmail.com>
Subject Re: How to control the map and reduce step sequentially
Date Tue, 29 Jul 2008 05:08:33 GMT
I got it. Thanks!

2008/7/28 Shengkai Zhu <geniusjash@gmail.com>

> The real reduce logic is actually started when all map tasks are finished.
>
> Is it still unexpected?
>
>
> On 7/28/08, 晋光峰 <jinguangfeng@gmail.com> wrote:
> >
> > Dear All,
> >
> > When i using Hadoop, I noticed that the reducer step is started
> immediately
> > when the mappers are still running. According to my project requirement,
> > the
> > reducer step should not start until all the mappers finish their
> execution.
> > Anybody knows how to use some Hadoop API to achieve this? When all the
> > mappers finish their process, then the reducer is started.
> >
> > Thanks
> > --
> > Guangfeng Jin
> >
>
>
>
> --
>
> 朱盛凯
>
> Jash Zhu
>
> 复旦大学软件学院
>
> Software School, Fudan University
>



-- 
Guangfeng Jin
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message