Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CACmJb3wb2FtCnuT49OQz05iazjNTg9A6GB9kEZrob_sPwJ8bVg@mail.gmail.com>
References: 
 <CAMLkhjxQ75c9OjiV=xa2rep6=WRpMePhzU=ktgDqvrH6H9gphA@mail.gmail.com>
	<CACmJb3wb2FtCnuT49OQz05iazjNTg9A6GB9kEZrob_sPwJ8bVg@mail.gmail.com>
Date: Thu, 17 Dec 2015 14:09:57 -0500
Message-ID: 
 <CAMLkhjz5-K9hzNsvOKahkmvN7EE9VsCpusXJJCu9X4-L=yFsoA@mail.gmail.com>
Subject: Re: Running multiple copies of each task
From: Sultan Alamro <sultan.alamro@gmail.com>
To: Namikaze Minato <lloydsensei@gmail.com>
Cc: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a1149298cce229905271cc4cb

--001a1149298cce229905271cc4cb
Content-Type: text/plain; charset=UTF-8

Thanks Namikaze!

Another question:

New tasks in hadoop always have higher priority than speculative tasks.
Does anyone know how and where I can change this priority?


Thanks,
Sultan


On Thu, Dec 3, 2015 at 7:46 AM, Namikaze Minato <lloydsensei@gmail.com>
wrote:

> I think you are looking for mapreduce.reduce.speculative
> Be careful, for some reason, this fell into my spam folder.
>
> Regards,
> LLoyd
>
> On 3 December 2015 at 01:05, Sultan Alamro <sultan.alamro@gmail.com>
> wrote:
> > Hi there,
> >
> > I have been looking at the hadoop source code 2.6.0 trying to understand
> the
> > low level details and how the framework is actually working.
> >
> > I have a simple idea and I am trying to figure out where and how the idea
> > can be implemented. The idea can be described in one sentence: "Running
> > multiple copies of each task". However, implementing the idea is not as
> > simple as I think.
> >
> > What I am aware of is that I only need to modify a few classes. But,
> which
> > classes?
> >
> > I just need someone to guide me to the right direction.
> >
> >
> > Best,
> > Sultan
>

--001a1149298cce229905271cc4cb
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div>Thanks Namikaze!<br><br></div>Another quest=
ion:<br><br>New tasks in hadoop always have higher priority than speculativ=
e tasks. <br>Does anyone know how and where I can change this priority? <br=
><br><br></div>Thanks, <br></div>Sultan<br><div><div><br></div></div></div>=
<div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Thu, Dec 3, 20=
15 at 7:46 AM, Namikaze Minato <span dir=3D"ltr">&lt;<a href=3D"mailto:lloy=
dsensei@gmail.com" target=3D"_blank">lloydsensei@gmail.com</a>&gt;</span> w=
rote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;borde=
r-left:1px #ccc solid;padding-left:1ex">I think you are looking for mapredu=
ce.reduce.speculative<br>
Be careful, for some reason, this fell into my spam folder.<br>
<br>
Regards,<br>
LLoyd<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
On 3 December 2015 at 01:05, Sultan Alamro &lt;<a href=3D"mailto:sultan.ala=
mro@gmail.com">sultan.alamro@gmail.com</a>&gt; wrote:<br>
&gt; Hi there,<br>
&gt;<br>
&gt; I have been looking at the hadoop source code 2.6.0 trying to understa=
nd the<br>
&gt; low level details and how the framework is actually working.<br>
&gt;<br>
&gt; I have a simple idea and I am trying to figure out where and how the i=
dea<br>
&gt; can be implemented. The idea can be described in one sentence: &quot;R=
unning<br>
&gt; multiple copies of each task&quot;. However, implementing the idea is =
not as<br>
&gt; simple as I think.<br>
&gt;<br>
&gt; What I am aware of is that I only need to modify a few classes. But, w=
hich<br>
&gt; classes?<br>
&gt;<br>
&gt; I just need someone to guide me to the right direction.<br>
&gt;<br>
&gt;<br>
&gt; Best,<br>
&gt; Sultan<br>
</div></div></blockquote></div><br></div>

--001a1149298cce229905271cc4cb--