Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
In-Reply-To: 
 <CAL8XniqrdSyZeRA0f9Na9wk5-oLVi4BEmFiMpUeKmMyo7CgSPA@mail.gmail.com>
References: 
 <CAL8XniqrdSyZeRA0f9Na9wk5-oLVi4BEmFiMpUeKmMyo7CgSPA@mail.gmail.com>
Date: Mon, 22 Feb 2016 17:37:41 +0530
Message-ID: 
 <CANOghCURF9HgpPKWk9DfVxRMBBox-CqVAHu=e0UgEhzkDZ8_5g@mail.gmail.com>
Subject: Re: Hadoop-2.7.2 MR job stuck in accepted state
From: Varun Saxena <vsaxena.varun@gmail.com>
To: kumar r <kumarccpp@gmail.com>
Cc: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=089e0116081602cd92052c5aae6d

--089e0116081602cd92052c5aae6d
Content-Type: text/plain; charset=UTF-8

Hi Kumar,

This has to do with yarn.scheduler.capacity.maximum-am-resource-percent
which by default is 0.1
This parameter is used to control the number of concurrently running apps.
Refer to
https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html#Queue_Properties

Regards,
Varun Saxena

On Mon, Feb 22, 2016 at 12:01 PM, kumar r <kumarccpp@gmail.com> wrote:

> Hi,
>
> I have configured hadoop-2.7.2 pseudo-node cluster in windows. When i
> submit a MR job, it works fine. But if i submit multiple MR jobs then only
> one job runs at a time.
>
> First job is in RUNNING state and all other job in ACCEPTED state even
> yarn has enough memory (3 GB free out of 6 GB).
> But the same works fine in hadoop-2.5.2
>
>
> *yarn-site.xml*
>
> <property>
>  <name>yarn.nodemanager.resource.memory-mb</name>
>  <value>6144</value>
> </property>
> <property>
>  <name>yarn.scheduler.minimum-allocation-mb</name>
>  <value>256</value>
> </property>
> <property>
>  <name>yarn.scheduler.maximum-allocation-mb</name>
>  <value>2250</value>
> </property>
>
> Any new property to be set for running multiple job at a time?
>
> Stack Overflow Question : http://stackoverflow.com/questions/35545986/hadoop-2-7-2-mr-job-in-accepted-state
>
> Thanks,
>
> Kumar
>
>

--089e0116081602cd92052c5aae6d
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Kumar,=C2=A0<div><br></div><div>This has to do with=C2=
=A0<span style=3D"color:rgb(51,51,51);font-family:Arial,sans-serif;font-siz=
e:14px;line-height:20px">yarn.scheduler.capacity.maximum-am-resource-percen=
t which by default is 0.1</span></div><div><font color=3D"#333333" face=3D"=
Arial, sans-serif"><span style=3D"font-size:14px;line-height:20px">This par=
ameter is used to control the number of concurrently running apps.</span></=
font></div><div><font color=3D"#333333" face=3D"Arial, sans-serif"><span st=
yle=3D"font-size:14px;line-height:20px">Refer to=C2=A0<a href=3D"https://ha=
doop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.=
html#Queue_Properties">https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/ha=
doop-yarn-site/CapacityScheduler.html#Queue_Properties</a></span></font></d=
iv><div><span style=3D"color:rgb(51,51,51);font-family:Arial,sans-serif;fon=
t-size:14px;line-height:20px"><br></span></div><div><span style=3D"color:rg=
b(51,51,51);font-family:Arial,sans-serif;font-size:14px;line-height:20px">R=
egards,</span></div><div><span style=3D"color:rgb(51,51,51);font-family:Ari=
al,sans-serif;font-size:14px;line-height:20px">Varun Saxena</span></div></d=
iv><div class=3D"gmail_extra"><br><div class=3D"gmail_quote">On Mon, Feb 22=
, 2016 at 12:01 PM, kumar r <span dir=3D"ltr">&lt;<a href=3D"mailto:kumarcc=
pp@gmail.com" target=3D"_blank">kumarccpp@gmail.com</a>&gt;</span> wrote:<b=
r><blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:=
1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">Hi,<br><br>I have configu=
red hadoop-2.7.2 pseudo-node cluster in windows. When i submit a MR job, it=
=20
works fine. But if i submit multiple MR jobs then only one job runs at a
 time.<br><br><p>First job is in RUNNING state and all other job in ACCEPTE=
D state even yarn has enough memory (3 GB free out of 6 GB). </p>

But the same works fine in hadoop-2.5.2<br><br><strong>yarn-site.xml<br></s=
trong><br><pre><code>&lt;property&gt;
 &lt;name&gt;yarn.nodemanager.resource.memory-mb&lt;/name&gt;
 &lt;value&gt;6144&lt;/value&gt;
&lt;/property&gt;
&lt;property&gt;
 &lt;name&gt;yarn.scheduler.minimum-allocation-mb&lt;/name&gt;
 &lt;value&gt;256&lt;/value&gt;
&lt;/property&gt;
&lt;property&gt;
 &lt;name&gt;yarn.scheduler.maximum-allocation-mb&lt;/name&gt;
 &lt;value&gt;2250&lt;/value&gt;
&lt;/property&gt;<br><br></code></pre><pre><code>Any new property to be set=
 for running multiple job at a time?<br><br></code></pre><pre><code>Stack O=
verflow Question : <a href=3D"http://stackoverflow.com/questions/35545986/h=
adoop-2-7-2-mr-job-in-accepted-state" target=3D"_blank">http://stackoverflo=
w.com/questions/35545986/hadoop-2-7-2-mr-job-in-accepted-state</a><br></cod=
e></pre><pre><code>Thanks,<br></code></pre><pre><code>Kumar<br></code></pre=
></div>
</blockquote></div><br></div>

--089e0116081602cd92052c5aae6d--