Return-Path: 
 <user-return-19081-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 3D44617419
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Tue, 17 Mar 2015 17:12:18 +0000 (UTC)
Received: (qmail 26265 invoked by uid 500); 17 Mar 2015 17:12:12 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 26159 invoked by uid 500); 17 Mar 2015 17:12:12 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 26148 invoked by uid 99); 17 Mar 2015 17:12:12 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Mar 2015 17:12:12 +0000
X-ASF-Spam-Status: No, hits=1.7 required=5.0
	tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of gaurav.gopi123@gmail.com
 designates 209.85.217.175 as permitted sender)
Received: from [209.85.217.175] (HELO mail-lb0-f175.google.com)
 (209.85.217.175)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Mar 2015 17:11:47 +0000
Received: by lbcds1 with SMTP id ds1so11954933lbc.3
        for <user@hadoop.apache.org>; Tue, 17 Mar 2015 10:10:15 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=kVJ6z7av0fftVl1MwWHB3/raLfG8F+B0OXbamrkALZc=;
        b=b25vFUmR50jH3C9iv12QBk5HOgecQsOQtfH5Rol/AQQh/JBJnb2GqVX6nZaMsNtZx5
         v3J0Pf/oD53rfr6S8sazIDF0kTUgIITCBLq6bs4ASxSUxiVigVKXU7Npnuk5By0NWtUH
         +mgcx3GwXM6UAg58ZiZin6DMLgOP77xP0GkxwreWhr5GYlJZfVJJjoTdyMtbLJlBy846
         ci7VHUzJtc9ijhafo/rWDLp6e5COFLEUdOVM+wDl8FcjkuHWXl7oj1ne3UOzyjdkSTzh
         jo6HbRyw40usd9zvbZUS+72gxB6/XgYHb7oNw//UKrShZJX1luNM28qrURFCAQNfMvb4
         Fung==
MIME-Version: 1.0
X-Received: by 10.152.197.34 with SMTP id ir2mr60574104lac.36.1426612215852;
 Tue, 17 Mar 2015 10:10:15 -0700 (PDT)
Received: by 10.25.20.201 with HTTP; Tue, 17 Mar 2015 10:10:15 -0700 (PDT)
In-Reply-To: 
 <AD354F56741A1B47882A625909A59C692BDCFDFF@SZXEML505-MBX.china.huawei.com>
References: 
 <CAJpToqd+duxvqve=S9yrzY6a-qF75yf172DdLgiZHOG=pYEsyg@mail.gmail.com>
	<AD354F56741A1B47882A625909A59C692BDCFDFF@SZXEML505-MBX.china.huawei.com>
Date: Tue, 17 Mar 2015 10:10:15 -0700
Message-ID: 
 <CAJpToqczFBbRC9vcvL9TnH5gxW6jv9mE4y5pGSKZP4Zp3qEmpw@mail.gmail.com>
Subject: Re: YARN ignores host-specific resource requests
From: Gaurav Gupta <gaurav.gopi123@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001a11343d1c5bb25805117f0af8
X-Virus-Checked: Checked by ClamAV on apache.org

--001a11343d1c5bb25805117f0af8
Content-Type: text/plain; charset=UTF-8

Hey Naga,

Thanks for the suggestion. The configuration works with HDP but with CDH it
doesn't work.
I tried with both Faire and Capacity Scheduler.

Here is my configuration that I have for Capacity Scheduler in CDH

<?xml version="1.0"?>
<configuration>
  <property>
    <name>yarn.scheduler.capacity.root.queues</name>
    <value>default</value>
  </property>
  <property>
    <name>yarn.scheduler.capacity.root.capacity</name>
    <value>100</value>
  </property>
  <property>
    <name>yarn.scheduler.capacity.root.default.capacity</name>
    <value>100</value>
  </property>
  <property>
      <name>yarn.scheduler.capacity.node-locality-delay</name>
      <value>40</value>
    </property>
</configuration>

Thanks
Gaurav

On Mon, Mar 16, 2015 at 8:41 PM, Naganarasimha G R (Naga) <
garlanaganarasimha@huawei.com> wrote:

>  Hi Gaurav,
> If you are using Capacity scheduler then try configuring to yarn.scheduler.capacity.node-locality-delay
> to the size of cluster.
> By default its set to -1 which make scheduler to assign the container to
> non local nodes
>
>  Regards,
> Naga
>  ------------------------------
> *From:* Gaurav Gupta [gaurav.gopi123@gmail.com]
> *Sent:* Tuesday, March 17, 2015 03:41
> *To:* user@hadoop.apache.org
> *Subject:* YARN ignores host-specific resource requests
>
>   Hi,
> I am trying to allocate containers on a particular host. But I don't get
> the back the resources.
>
>  I am setting relaxedLocality to false and rack to null.
>
>  Any pointers?
>
>  Thanks
> Gaurav
>

--001a11343d1c5bb25805117f0af8
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hey Naga,<div><br></div><div>Thanks for the suggestion. Th=
e configuration works with HDP but with CDH it doesn&#39;t work.=C2=A0</div=
><div>I tried with both Faire and Capacity Scheduler.=C2=A0</div><div><br><=
/div><div>Here is my configuration that I have for Capacity Scheduler in CD=
H</div><div><br></div><div><div>&lt;?xml version=3D&quot;1.0&quot;?&gt;</di=
v><div>&lt;configuration&gt;</div><div>=C2=A0 &lt;property&gt;</div><div>=
=C2=A0 =C2=A0 &lt;name&gt;yarn.scheduler.capacity.root.queues&lt;/name&gt;<=
/div><div>=C2=A0 =C2=A0 &lt;value&gt;default&lt;/value&gt;</div><div>=C2=A0=
 &lt;/property&gt;</div><div>=C2=A0 &lt;property&gt;</div><div>=C2=A0 =C2=
=A0 &lt;name&gt;yarn.scheduler.capacity.root.capacity&lt;/name&gt;</div><di=
v>=C2=A0 =C2=A0 &lt;value&gt;100&lt;/value&gt;</div><div>=C2=A0 &lt;/proper=
ty&gt;</div><div>=C2=A0 &lt;property&gt;</div><div>=C2=A0 =C2=A0 &lt;name&g=
t;yarn.scheduler.capacity.root.default.capacity&lt;/name&gt;</div><div>=C2=
=A0 =C2=A0 &lt;value&gt;100&lt;/value&gt;</div><div>=C2=A0 &lt;/property&gt=
;</div><div>=C2=A0 &lt;property&gt;</div><div>=C2=A0 =C2=A0 =C2=A0 &lt;name=
&gt;yarn.scheduler.capacity.node-locality-delay&lt;/name&gt;</div><div>=C2=
=A0 =C2=A0 =C2=A0 &lt;value&gt;40&lt;/value&gt;</div><div>=C2=A0 =C2=A0 &lt=
;/property&gt;</div><div>&lt;/configuration&gt;</div></div><div><br></div><=
div>Thanks</div><div>Gaurav</div></div><div class=3D"gmail_extra"><br><div =
class=3D"gmail_quote">On Mon, Mar 16, 2015 at 8:41 PM, Naganarasimha G R (N=
aga) <span dir=3D"ltr">&lt;<a href=3D"mailto:garlanaganarasimha@huawei.com"=
 target=3D"_blank">garlanaganarasimha@huawei.com</a>&gt;</span> wrote:<br><=
blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px=
 #ccc solid;padding-left:1ex">




<div>
<div style=3D"direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt=
">Hi Gaurav,
<div><span style=3D"white-space:pre-wrap"></span>If you are using Capacity =
scheduler then try configuring to=C2=A0<span style=3D"color:rgb(51,51,51);f=
ont-family:monospace;font-size:11px;background-color:rgb(238,238,238)">yarn=
.scheduler.capacity.node-locality-delay
</span>to the size of cluster.=C2=A0</div>
<div>By default its set to -1 which make scheduler to assign the container =
to non local nodes=C2=A0</div>
<div><br>
</div>
<div>Regards,</div>
<div>Naga<br>
<div style=3D"font-family:Times New Roman;color:#000000;font-size:16px">
<hr>
<div style=3D"direction:ltr"><font face=3D"Tahoma" color=3D"#000000"><b>Fro=
m:</b> Gaurav Gupta [<a href=3D"mailto:gaurav.gopi123@gmail.com" target=3D"=
_blank">gaurav.gopi123@gmail.com</a>]<br>
<b>Sent:</b> Tuesday, March 17, 2015 03:41<br>
<b>To:</b> <a href=3D"mailto:user@hadoop.apache.org" target=3D"_blank">user=
@hadoop.apache.org</a><br>
<b>Subject:</b> YARN ignores host-specific resource requests<br>
</font><br>
</div><div><div class=3D"h5">
<div></div>
<div>
<div dir=3D"ltr">Hi,
<div>I am trying to allocate containers on a particular host. But I don&#39=
;t get the back the resources.</div>
<div><br>
</div>
<div>I am setting relaxedLocality to false and rack to null.=C2=A0</div>
<div><br>
</div>
<div>Any pointers?</div>
<div><br>
</div>
<div>Thanks</div>
<div>Gaurav</div>
</div>
</div>
</div></div></div>
</div>
</div>
</div>

</blockquote></div><br></div>

--001a11343d1c5bb25805117f0af8--