Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: message received from 54.164.171.186
 which is an MX secondary for user@hadoop.apache.org)
MIME-Version: 1.0
From: Yang <teddyyyy123@gmail.com>
Date: Mon, 27 Apr 2015 15:30:33 -0700
Message-ID: 
 <CAAnh3_87MXMauQiUpBHfsWfj_KUuizeZMXFOx5T6V7MZWjeurg@mail.gmail.com>
Subject: in YARN/MR2,
 can I still submit multiple jobs to one MR application master?
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=20cf303bf71e8d02890514bc4c69

--20cf303bf71e8d02890514bc4c69
Content-Type: text/plain; charset=UTF-8

conceptually, the MR application master is similar to the old job tracker.

if so, can I submit multiple jobs to the same MR application master?  it
looks like an odd use case, the context is that we have users generating
lots of MR jobs, and he currently has a little crude scheduler that
periodically launches jobs to the RM by just "hadoop jar ..."

instead I was thinking to "carve out" a MR2 allocation in RM first, then
periodically submit to the "job tracker"/application master, so that all
the jobs are localized to this allocation.


I was also thinking about using Tez instead of MR application master. Tez
replaces MR2 application master, not on top of it, right?

Thanks
Yang

--20cf303bf71e8d02890514bc4c69
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">conceptually, the MR application master is similar to the =
old job tracker.<div><br></div><div>if so, can I submit multiple jobs to th=
e same MR application master? =C2=A0it looks like an odd use case, the cont=
ext is that we have users generating lots of MR jobs, and he currently has =
a little crude scheduler that periodically launches jobs to the RM by just =
&quot;hadoop jar ...&quot;</div><div><br></div><div>instead I was thinking =
to &quot;carve out&quot; a MR2 allocation in RM first, then periodically su=
bmit to the &quot;job tracker&quot;/application master, so that all the job=
s are localized to this allocation.</div><div><br></div><div><br></div><div=
>I was also thinking about using Tez instead of MR application master. Tez =
replaces MR2 application master, not on top of it, right?</div><div><br></d=
iv><div>Thanks</div><div>Yang</div></div>

--20cf303bf71e8d02890514bc4c69--