Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 443FD200B33 for ; Wed, 15 Jun 2016 05:17:32 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 42D65160A56; Wed, 15 Jun 2016 03:17:32 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3BB21160A06 for ; Wed, 15 Jun 2016 05:17:31 +0200 (CEST) Received: (qmail 41572 invoked by uid 500); 15 Jun 2016 03:17:28 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 41556 invoked by uid 99); 15 Jun 2016 03:17:27 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 15 Jun 2016 03:17:27 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 6AA68C0D9E for ; Wed, 15 Jun 2016 03:17:27 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -1.727 X-Spam-Level: X-Spam-Status: No, score=-1.727 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-1.426, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=unsw.onmicrosoft.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id nU9IaYSt3zxM for ; Wed, 15 Jun 2016 03:17:25 +0000 (UTC) Received: from INFPACM004.services.comms.unsw.edu.au (smtp.unsw.edu.au [149.171.193.32]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTP id 744065FBC5 for ; Wed, 15 Jun 2016 03:17:24 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A2DRAQBbx2BX/zgaFKxdgnCBJE8EKga7M?= =?us-ascii?q?4F5FwEMhXMCgWwUAQEBAQEBAWUcC4RSEgEaEwEBOBEBFWsmAQQbGod0AxcOni0?= =?us-ascii?q?BgScBHGEFKAKKbAEBhSgBAQWIPBg5gy8BCx0DBYYniHcYgkcLQBiCL412hVOFJ?= =?us-ascii?q?YYFkgCFRo90HjaBeoF1bgEBAYkGAX4BAQE?= X-IPAS-Result: =?us-ascii?q?A2DRAQBbx2BX/zgaFKxdgnCBJE8EKga7M4F5FwEMhXMCgWw?= =?us-ascii?q?UAQEBAQEBAWUcC4RSEgEaEwEBOBEBFWsmAQQbGod0AxcOni0BgScBHGEFKAKKb?= =?us-ascii?q?AEBhSgBAQWIPBg5gy8BCx0DBYYniHcYgkcLQBiCL412hVOFJYYFkgCFRo90Hja?= =?us-ascii?q?BeoF1bgEBAYkGAX4BAQE?= X-IronPort-AV: E=Sophos;i="5.26,474,1459778400"; d="scan'208,217";a="294231790" Received: from unknown (HELO INFPWXH003.ad.unsw.edu.au) ([172.20.26.56]) by INFPACM004.services.comms.unsw.edu.au with ESMTP; 15 Jun 2016 13:17:16 +1000 Received: from AUS01-ME1-obe.outbound.protection.outlook.com (65.55.88.151) by hybrid.unsw.edu.au (149.171.58.238) with Microsoft SMTP Server (TLS) id 14.3.248.2; Wed, 15 Jun 2016 13:17:16 +1000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=unsw.onmicrosoft.com; s=selector1-unsw-edu-au; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Y7DUolwBDCIudpvQkShpKpbTvTgEsTRDCQ55m1SRTxU=; b=DHOvAqeYh0n+azP091vvbqnf/EnoM446eqKHss750St9XiLKVzi3gPna7K/Boa1ZcRCQpd5sS3s55Y2d7rMOCNHZDTxiZr/oUWIIK47HnK1C5Wn91cc6bsdAwsuVHWdi3uW5XLAzT6k/2aRH5yMYr8IL34e5oBNJd5ev2fDQCAA= Received: from SYXPR01MB0749.ausprd01.prod.outlook.com (10.169.176.141) by SYXPR01MB0749.ausprd01.prod.outlook.com (10.169.176.141) with Microsoft SMTP Server (TLS) id 15.1.517.8; Wed, 15 Jun 2016 03:17:15 +0000 Received: from SYXPR01MB0749.ausprd01.prod.outlook.com ([10.169.176.141]) by SYXPR01MB0749.ausprd01.prod.outlook.com ([10.169.176.141]) with mapi id 15.01.0517.013; Wed, 15 Jun 2016 03:17:15 +0000 From: Phillip Wu To: "user@hadoop.apache.org" Subject: maximum-am-resource-percent is insufficient to start a single application Thread-Topic: maximum-am-resource-percent is insufficient to start a single application Thread-Index: AdHF2eF5OCv6eGMTTl2LSzocwHOzTQA2nnpg Date: Wed, 15 Jun 2016 03:17:14 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=phillip.wu@unsw.edu.au; x-originating-ip: [149.171.197.251] x-ms-office365-filtering-correlation-id: ea9aaa44-5ab1-45b0-6326-08d394cb8cd3 x-microsoft-exchange-diagnostics: 1;SYXPR01MB0749;6:8qYXfW+j54+XNi7UwPGNVrwj5Mc5YuJq4xU9+Gjb4XIjm+yEpe5/TzbOvWk9CJgs6u3lVnllL5iEdH7Oqs5GeaR9rehKUoEm7kJv72E/2tg4VV7F77kmOogwkNSuuKiK3FlRBy/98Qoek7kQgLHkxXQWhILQkNZGAdvDeIEiTVWEe91ouM8d3H+y3k666KDh+p1TNUNem7/iEEGsTKI5UbxeoPD0xevnUzdz1xyPdFnvJQkkdOSLtDa2BuDRKD+NUyuwuEYzC9x9d893Ce2aow==;5:2LdxY+IHc5s6OjWuxseDLAdZ4z0STeU1l6dRzkRRZYp75hqFBE8sYK3KR7cJN6BswNnc/iHn9mxgp4MYxo3gH+aeP+Y37vWOJC04e2O3N0yWBkoKoO8Z7tY+PIi4Vf5onEagdyjDWMh9Vu3eF1MJdg==;24:JONwcUkZJWJI2d0rBa4ieB/Q4OHbeLOeK5xg1FuIRPuX39idl6PupMKKOSgwZGC9lXwpyBx2pblw7uZffUdC2Rzo5uyIBw9IiO1gDoS4A94=;7:l0+cPeRygmGCmBebfaqe4xTo7HcuITTdC0KEqaosCxVlhasUxuhAras7lWsYmYLUBlY2UbwHDjOSQVSydi2o+DWs7CL+T7H4GUW82q94hpqPp2uyLj/9dChLVKLJnaGurW4j/xoFvvQs70+nHH39OtnbqYoHH30VPyQXy4F2PAM522g6mqENYiCzpSqmy6g1WOduWhKXg8fLepsxZDvJRw== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:SYXPR01MB0749; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(2401047)(8121501046)(5005006)(10201501046)(3002001);SRVR:SYXPR01MB0749;BCL:0;PCL:0;RULEID:;SRVR:SYXPR01MB0749; x-forefront-prvs: 09749A275C x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(6009001)(7916002)(189002)(199003)(51234002)(76576001)(2900100001)(88552002)(189998001)(87936001)(5004730100002)(33656002)(15975445007)(19625215002)(77096005)(5002640100001)(74482002)(74316001)(19580395003)(54356999)(3660700001)(97736004)(450100001)(50986999)(68736007)(110136002)(107886002)(5003600100002)(101416001)(3280700002)(92566002)(5008740100001)(81166006)(8676002)(229853001)(81156014)(1730700003)(122556002)(66066001)(105586002)(2906002)(230783001)(2351001)(16236675004)(86362001)(2501003)(790700001)(10400500002)(9686002)(8936002)(19300405004)(106356001)(6116002)(586003)(9326002)(11100500001)(102836003)(3846002);DIR:OUT;SFP:1102;SCL:1;SRVR:SYXPR01MB0749;H:SYXPR01MB0749.ausprd01.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;CAT:NONE;LANG:en;CAT:NONE; received-spf: None (protection.outlook.com: unsw.edu.au does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_SYXPR01MB0749CA6EA09D9282F3DAD6DBC1550SYXPR01MB0749ausp_" MIME-Version: 1.0 X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Jun 2016 03:17:14.9745 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 3ff6cfa4-e715-48db-b8e1-0867b9f9fba3 X-MS-Exchange-Transport-CrossTenantHeadersStamped: SYXPR01MB0749 X-OriginatorOrg: unsw.edu.au archived-at: Wed, 15 Jun 2016 03:17:32 -0000 --_000_SYXPR01MB0749CA6EA09D9282F3DAD6DBC1550SYXPR01MB0749ausp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I'm new to Hadoop and Hive. I'm using Hadoop 2.6.4 (binary I got from internet) & Hive 2.0.1 (binary I = got from internet). I can create a database and table in hive. However when I try to insert a record into a previously created table I get= : "org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue= : maximum-am-resource-percent is insufficient to start a single application= in queue" yarn-site.xml yarn.resourcemanager.scheduler.class org.apache.hadoop.yarn.server.resourcemanager.scheduler.capaci= ty.CapacityScheduler capacity-scheduler.xml yarn.scheduler.capacity.maximum-am-resource-percent 1.0 Maximum percent of resources in the cluster which can be used to run application masters i.e. controls number of concurrent running applications. According to the documentation this means I have allocated 100% to my one a= nd only default scheduler queue. [https://hadoop.apache.org/docs/r2.6.4/hadoop-yarn/hadoop-yarn-site/Capacit= yScheduler.html] "yarn.scheduler.capacity.maximum-am-resource-percent / yarn.scheduler.capac= ity..maximum-am-resource-percent Maximum percent of resources in the cluster which can be used to run applic= ation masters - controls number of concurrent active applications. Limits on each queue are directly proportional to their queue capacities an= d user limits. Specified as a float - ie 0.5 =3D 50%. Default is 10%. This can be set for = all queues with yarn.scheduler.capacity.maximum-am-resource-percent and can= also be overridden on a per queue basis by setting yarn.scheduler.capacity..maximum-am-resource-percent" Can someone tell me how to fix this? --_000_SYXPR01MB0749CA6EA09D9282F3DAD6DBC1550SYXPR01MB0749ausp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

I'm new to Hadoop and Hive.

 

I'm using Hadoop 2.6.4 (binary I got from internet) = & Hive 2.0.1 (binary I got from internet).

I can create a database and table in hive.

 

However when I try to insert a record into a previou= sly created table I get:

"org.apache.hadoop.yarn.server.resourcemanager.= scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient t= o start a single application in queue"

 

yarn-site.xml

<property>

      <name>yarn.reso= urcemanager.scheduler.class</name>

      <value>org.apac= he.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler&= lt;/value>

</property>

 

capacity-scheduler.xml

<property>

    <name>yarn.scheduler.capaci= ty.maximum-am-resource-percent</name>

    <value>1.0</value>

    <description>

      Maximum percent of re= sources in the cluster which can be used to run

      application masters i= .e. controls number of concurrent running

      applications.

    </description>

  </property>

 

According to the documentation this means I have all= ocated 100% to my one and only default scheduler queue.

[https://hadoop.apache.org/docs/r2.6.4/hadoop-yarn/h= adoop-yarn-site/CapacityScheduler.html]

"yarn.scheduler.capacity.maximum-am-resource-pe= rcent / yarn.scheduler.capacity.<queue-path>.maximum-am-resource-perc= ent

Maximum percent of resources in the cluster which ca= n be used to run application masters - controls number of concurrent active= applications.

Limits on each queue are directly proportional to th= eir queue capacities and user limits.

Specified as a float - ie 0.5 =3D 50%. Default is 10= %. This can be set for all queues with yarn.scheduler.capacity.maximum-am-r= esource-percent and can also be overridden on a per queue basis by setting<= o:p>

yarn.scheduler.capacity.<queue-path>.maximum-a= m-resource-percent"

 

Can someone tell me how to fix this?

--_000_SYXPR01MB0749CA6EA09D9282F3DAD6DBC1550SYXPR01MB0749ausp_--