Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0A10C10FD8 for ; Thu, 4 Jul 2013 21:52:37 +0000 (UTC) Received: (qmail 73040 invoked by uid 500); 4 Jul 2013 21:52:32 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 72943 invoked by uid 500); 4 Jul 2013 21:52:32 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 72936 invoked by uid 99); 4 Jul 2013 21:52:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Jul 2013 21:52:32 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of tucu@cloudera.com designates 209.85.216.176 as permitted sender) Received: from [209.85.216.176] (HELO mail-qc0-f176.google.com) (209.85.216.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 04 Jul 2013 21:52:26 +0000 Received: by mail-qc0-f176.google.com with SMTP id z10so946183qcx.21 for ; Thu, 04 Jul 2013 14:52:05 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=DPgbdeooFVXrYe7huqzpaKgfQUOP7fXuRQqbZmkImdI=; b=SfmAWwH9tcG2OfWwVTCJIWoaC6Yel944IDfl1WGdskLrm90KVd55EPpbP5wb4J6zUp ewtOx6tYoqhKnCbEpDpf+gIB2JSbfyBeAJWBk1BiiCEBiSa7iQcQLkyglJM3pgs4qGAZ FAm5qPPlVIMY9gvjeStgAsFtPTdFyZFVRm23bj2WuHe097I1lvi5VBAJ+r/xFHlCJUoh n78bUlGmF/TdagEyLAI4D/CZCIzY/I7Mui/9R8BEqYLTaBv39ntgmAx1JPDJ/Kcv6Byq LciV4BbfwSR00LGhxpK/zlDkpHBvw8KUdSLSylhjo2vtIk/OTK2xZZWzN/O+QejcLwPc GKQA== X-Received: by 10.49.30.104 with SMTP id r8mr5577700qeh.27.1372974725519; Thu, 04 Jul 2013 14:52:05 -0700 (PDT) MIME-Version: 1.0 Received: by 10.49.61.41 with HTTP; Thu, 4 Jul 2013 14:51:35 -0700 (PDT) In-Reply-To: <869970D71E26D7498BDAC4E1CA92226B658D9F85@MBX021-E3-NJ-2.exch021.domain.local> References: <4AAA490D-B31B-4491-BA06-E38631E4ABAD@hortonworks.com> <869970D71E26D7498BDAC4E1CA92226B658D9F85@MBX021-E3-NJ-2.exch021.domain.local> From: Alejandro Abdelnur Date: Thu, 4 Jul 2013 14:51:35 -0700 Message-ID: Subject: Re: Requesting containers on a specific host To: "common-user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=047d7bea4484cceb0704e0b69653 X-Gm-Message-State: ALoCoQk0fAPzeY4N+tQ/qdFKRsa5LpVSAs4PkfWkE2xIto4Gpleyg0iN3u8qgzj3rEL6wiIaU3fB X-Virus-Checked: Checked by ClamAV on apache.org --047d7bea4484cceb0704e0b69653 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable John, This feature will available in the upcoming 2.1.0-beta release. The first release candidate (RC) has been cut, but it seems a new RC will be needed. The exact release date is still not known but it should be soon. thanks. On Thu, Jul 4, 2013 at 2:43 PM, John Lilley wrote= : > Arun,**** > > I=92m don=92t know how to interpret the release schedule from the JIRA. = It > says that the patch targets 2.1.0 and it is checked into the trunk, does > that mean it is likely to be rolled into the first Hadoop 2 GA or will it > have to wait for another cycle?**** > > Thanks,**** > > John**** > > ** ** > > *From:* Arun C Murthy [mailto:acm@hortonworks.com] > *Sent:* Thursday, July 04, 2013 6:28 AM > *To:* user@hadoop.apache.org > *Subject:* Re: Requesting containers on a specific host**** > > ** ** > > To guarantee nodes on a specific container you need to use the whitelist > feature we added recently:**** > > https://issues.apache.org/jira/browse/YARN-398**** > > Arun**** > > ** ** > > On Jul 4, 2013, at 3:14 AM, Krishna Kishore Bonagiri < > write2kishore@gmail.com> wrote:**** > > > > **** > > I could get containers on specific nodes using addContainerRequest() on > AMRMClient. But there are issues with it. I have two nodes, node1 and nod= e2 > in my cluster. And, my Application Master is trying to get 3 containers o= n > node1, and 3 containers on node2 in that order. **** > > ** ** > > While trying to request on node1, it sometimes gives me those on node2, > and vice verse. When I get a container on a different node than the one I > need, I release it and make a fresh request. I am having to do like that > forever to get a container on the node I need. **** > > ** ** > > Though the node I am requesting has enough resources, why does it keep > giving me containers on the other node? How can I make sure I get a > container on the node I want? **** > > ** ** > > Note: I am using the default scheduler, i.e. Capacity Scheduler.**** > > ** ** > > Thanks,**** > > Kishore**** > > ** ** > > On Fri, Jun 21, 2013 at 7:25 PM, Arun C Murthy > wrote:**** > > Check if the hostname you are setting is the same in the RM logs=85**** > > ** ** > > On Jun 21, 2013, at 2:15 AM, Krishna Kishore Bonagiri < > write2kishore@gmail.com> wrote:**** > > > > **** > > Hi,**** > > I am trying to get container on a specific host, using setHostName(0 > call on ResourceRequest, but could not get allocated anything forever, > which just works fine when I change the node name to "*". I am working on= a > single node cluster, and I am giving the name of the single node I have i= n > my cluster. **** > > ** ** > > Is there any specific format that I need to give for setHostName(), why > is it not working...**** > > ** ** > > Thanks,**** > > Kishore**** > > ** ** > > --**** > > Arun C. Murthy**** > > Hortonworks Inc. > http://hortonworks.com/**** > > ** ** > > ** ** > > ** ** > > --**** > > Arun C. Murthy**** > > Hortonworks Inc. > http://hortonworks.com/**** > > ** ** > --=20 Alejandro --047d7bea4484cceb0704e0b69653 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable
John,

This feature will available= in the upcoming 2.1.0-beta release. The first release candidate (RC) has b= een cut, but it seems a new RC will be needed. The exact release date is st= ill not known but it should be soon.

thanks.


On Thu, Jul 4, 2013 at 2:43 PM, John = Lilley <john.lilley@redpoint.net> wrote:

Arun,

I=92m don=92t know how to= interpret the release schedule from the JIRA.=A0 It says that the patch ta= rgets 2.1.0 and it is checked into the trunk, does that mean it is likely to be rolled into the first Hadoop 2 GA or will it have to wait = for another cycle?

Thanks,

John=

=A0<= /p>

From: Arun C M= urthy [mailto:acm@= hortonworks.com]
Sent: Thursday, July 04, 2013 6:28 AM
To: user= @hadoop.apache.org
Subject: Re: Requesting containers on a specific host<= /span>

=A0

To guarantee nodes on a specific container you need = to use the whitelist feature we added recently:

https://issues.apach=
e.org/jira/browse/YARN-398

Arun

=A0

On Jul 4, 2013, at 3:14 AM, Krishna Kishore Bonagiri= <write2kis= hore@gmail.com> wrote:



I could get containers on specific nodes using addCo= ntainerRequest() on AMRMClient. But there are issues with it. I have two no= des, node1 and node2 in my cluster. And, my Application Master is trying to= get 3 containers on node1, and 3 containers on node2 in that order.=A0

=A0

While trying to request on node1, it sometimes gives= me those on node2, and vice verse. When I get a container on a different n= ode than the one I need, I release it and make a fresh request. I am having= to do like that forever to get a container on the node I need.=A0

=A0

=A0Though the node I am requesting has enough resour= ces, why does it keep giving me containers on the other node? How can I mak= e sure I get a container on the node I want?=A0

=A0

Note: I am using the default scheduler, i.e. Capacit= y Scheduler.

=A0

Thanks,

Kishore

=A0

On Fri, Jun 21, 2013 at 7:25 PM, Arun C Murthy <<= a href=3D"mailto:acm@hortonworks.com" target=3D"_blank">acm@hortonworks.com= > wrote:

Check if the hostname you are setting is the same in= the RM logs=85

=A0

On Jun 21, 2013, at 2:15 AM, Krishna Kishore Bonagir= i <write2ki= shore@gmail.com> wrote:



Hi,

=A0 I am trying to get container on a specific host,= using setHostName(0 call on ResourceRequest, but could not get allocated a= nything forever, which just works fine when I change the node name to "= ;*". I am working on a single node cluster, and I am giving the name of the single node I have in my cluster.=A0

=A0

=A0 Is there any specific format that I need to give= for setHostName(), why is it not working...

=A0

Thanks,

Kishore

=A0

--

Arun C. Murthy

Horton= works Inc.
http://hortonworks.co= m/

=A0

=A0

=A0

--

Arun C. Murthy

Horton= works Inc.
http://hortonworks.co= m/

=A0




--
Alejandro
--047d7bea4484cceb0704e0b69653--