hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From He Chen <airb...@gmail.com>
Subject Re: About MapReduce's Setup
Date Thu, 14 Oct 2010 04:41:33 GMT
Hi Hemanth

Thank you for your kindly reply. Do you know what really the setup do? Does
it will take the data locality into account?

On Wed, Oct 13, 2010 at 11:38 PM, Hemanth Yamijala <yhemanth@gmail.com>wrote:

> If you are talking about the 'Setup task' that is used to initialize
> or setup the job, yes, it can run on either the map slot or reduce
> slot depending on what is available.
>
> Thanks
> Hemanth
>
> On Thu, Oct 14, 2010 at 1:54 AM, He Chen <airbots@gmail.com> wrote:
> > Hi, all
> >
> > I found out that if the there is no map slot, Hadoop will use reduce slot
> to
> > setup mapreduce job when I submit a series of jobs.
> >
> > The first two jobs setuped themselves with a MapAttempt. However, they
> > occupy all the map slots. When the third job comes, I find out it uses
> the
> > ReduceAttempt to du the setup. After that, no more setup logged in the
> job
> > history.
> >
> > Am I correct?
> >
> >
> > Chen
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message