Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 626A710D51 for ; Thu, 5 Sep 2013 15:04:46 +0000 (UTC) Received: (qmail 79327 invoked by uid 500); 5 Sep 2013 15:04:40 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 78824 invoked by uid 500); 5 Sep 2013 15:04:37 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 78701 invoked by uid 99); 5 Sep 2013 15:04:36 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 15:04:36 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of rahul.rec.dgp@gmail.com designates 209.85.220.170 as permitted sender) Received: from [209.85.220.170] (HELO mail-vc0-f170.google.com) (209.85.220.170) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Sep 2013 15:04:29 +0000 Received: by mail-vc0-f170.google.com with SMTP id kw10so1268816vcb.1 for ; Thu, 05 Sep 2013 08:04:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=Rk7K/TtJHHPDjVLFikm0kv5f+x3SHyd7qA/iGnj70+E=; b=xq401Tkvq9tF930FLp/1yRwIaeeroTH/ystlXjeZ0C4KorPKpvqkjkUTwpzuHI1X7x 3D6an2DhIFzXzVpDDA7TcWCMVK8VvNbgOmxWjIfLA0Fkr2nDHck6sXYB+TCN6pS6Z83b SS/2O33y5BjVBntQIrL2RF+Vzg0DP7qXBcQJXd7DRlOqPO12lT+yBmYKNQ9zSQJ/uxzi 9sRVIkkdA35zAvd5LLzJtuQjgskjZu7up9hnnTbMXo9DYA6tCgMwV/8PgZCRhLgzybdu SLCQsM4+tmclgcbPVC95VX0r1mKVAXOhHPADjjuW3axZvKJpuYV7LavupQ813hPRkdiX WC5g== X-Received: by 10.221.27.73 with SMTP id rp9mr775490vcb.29.1378393448760; Thu, 05 Sep 2013 08:04:08 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.253.228 with HTTP; Thu, 5 Sep 2013 08:03:48 -0700 (PDT) From: Rahul Bhattacharjee Date: Thu, 5 Sep 2013 20:33:48 +0530 Message-ID: Subject: Question related to resource allocation in Yarn! To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a11339706dfcb4504e5a43b44 X-Virus-Checked: Checked by ClamAV on apache.org --001a11339706dfcb4504e5a43b44 Content-Type: text/plain; charset=UTF-8 Hi, I am trying to make a small poc on top of yarn. Within the launched application master , I am trying to request for 50 containers and launch a same task on those allocated containers. My config : AM registration response minimumCapability {, memory: 1024, virtual_cores: 1, }, maximumCapability {, memory: 8192, virtual_cores: 32, }, 1) I am asking for 1G mem and 1 core container to the RM. Ideally the RM should return me 6 - 7 containers , but the response always returns with only 2 containers. Why is that ? 2) So , when in the first ask 2 containers are returned , then I again required the RM for 50 - 2 = 48 containers. I keep getting 0 containers , even if the previously started containers have finished. Why is that ? Any link explaining the allocate request of RM would be very helpful. Thanks, Rahul --001a11339706dfcb4504e5a43b44 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi,

I am trying to make a small poc on top of yarn.

=
Within the launched application master , I am trying to request for 50 cont= ainers and launch=C2=A0 a same task on those allocated containers.

<= /div>
My co= nfig : AM registration response minimumCapability {, memory: 1024, virtual_= cores: 1, }, maximumCapability {, memory: 8192, virtual_cores: 32, },

= 1) I am asking for 1G mem and 1 core container to the RM. Ideally the RM sh= ould return me 6 - 7 containers , but the response always returns with only= 2 containers.

= Why is that ?

2) So , when in the first ask 2 containers are returned , = then I again required the RM for 50 - 2 =3D 48 containers. I keep getting 0= containers , even if the previously started containers have finished.

= Why is that ?

Any link explaining the allocate request of RM would be ve= ry helpful.

=
Than= ks,
Rahul
--001a11339706dfcb4504e5a43b44--