Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates
 209.85.223.175 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAFqxstFfe=HidY9Nc1ZjwU8b0PQUnnvJ20SRnzJvAkj0C=5rmQ@mail.gmail.com>
References: 
 <CAFqxstFfe=HidY9Nc1ZjwU8b0PQUnnvJ20SRnzJvAkj0C=5rmQ@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Tue, 19 Mar 2013 11:24:04 +0530
Message-ID: 
 <CAOcnVr3Pkd=W2NSfkCJ_sgq1v-iatyXrT7wiR3d-Jhaye4rsOw@mail.gmail.com>
Subject: Re: Question regarding job execution
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: multipart/alternative; boundary=14dae93404abdbb5ad04d840bcf2

--14dae93404abdbb5ad04d840bcf2
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

I am assuming you refer to the YARN's CapacityScheduler.

The CS in YARN does support parallel job (the right term is application, or
'app', not 'job' anymore, when speaking in YARN's context) execution. If
looking at code of CapacityScheduler.java and LeafQueue.java, you can
notice it iterate over all applications for node-update time assignments
(see nodeUpdate(=85) call (via NODE_UPDATE event) in former and
assignContainers(=85) call in the latter).

On Sun, Mar 3, 2013 at 1:28 PM, Jagmohan Chauhan <simplefundumnnit@gmail.co=
m
> wrote:

> Hi
>
> I am using Capacity scheduler on a  cluster of 5 nodes. I submit 3 jobs t=
o
> the system with a single queue for same user. I am observing that they ar=
e
> executed on FIFO basis even if the map slots are empty.  According to my
> observation , when the first job for the user ends then its 2nd job start=
s.
>
> Is it true that when using Capacity Scheduler, for any user, its next job
> will be executed when its prior job is finished?
>
>
>
> --
> Thanks and Regards
> Jagmohan Chauhan
> MSc student,CS
> Univ. of Saskatchewan
> IEEE Graduate Student Member
>
> http://homepage.usask.ca/~jac735/
>
>


--=20
Harsh J

--14dae93404abdbb5ad04d840bcf2
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I am assuming you refer to the YARN&#39;s CapacitySchedule=
r.<div>
<br></div><div>The CS in YARN does support parallel job (the right term is =
application, or &#39;app&#39;, not &#39;job&#39; anymore, when speaking in =
YARN&#39;s context) execution. If looking at code of CapacityScheduler.java=
 and LeafQueue.java, you can notice it iterate over all applications for no=
de-update time assignments (see nodeUpdate(=85) call (via NODE_UPDATE event=
) in former and assignContainers(=85) call in the latter).</div>

<div class=3D"gmail_extra"><br><div class=3D"gmail_quote">

On Sun, Mar 3, 2013 at 1:28 PM, Jagmohan Chauhan <span dir=3D"ltr">&lt;<a h=
ref=3D"mailto:simplefundumnnit@gmail.com" target=3D"_blank">simplefundumnni=
t@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi <br><br>I am using Capac=
ity scheduler on a=A0 cluster of 5 nodes. I=20
submit 3 jobs to the system with a single queue for same user. I am=20
observing that they are executed on FIFO basis even if the map slots are
 empty.=A0 According to my observation , when the first job for the user=20
ends then its 2nd job starts. <br>
<br>Is it true that when using Capacity Scheduler, for any user, its next j=
ob will be executed when its prior job is finished? <br><span><font color=
=3D"#888888"><br><br clear=3D"all"><br>-- <br><div dir=3D"ltr">
<div>Thanks and Regards</div>
<div>Jagmohan Chauhan=A0</div>
<div>MSc student,CS</div>
<div>Univ. of Saskatchewan=A0</div><div>IEEE Graduate=A0Student=A0Member</d=
iv><div><br></div><div><a href=3D"http://homepage.usask.ca/%7Ejac735/" targ=
et=3D"_blank">http://homepage.usask.ca/~jac735/</a></div></div>
<br></font></span></div>
</blockquote></div><br><br clear=3D"all"><div><br></div>-- <br>Harsh J
</div></div>

--14dae93404abdbb5ad04d840bcf2--