Return-Path: X-Original-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E2DB9176C0 for ; Thu, 17 Sep 2015 09:38:32 +0000 (UTC) Received: (qmail 53729 invoked by uid 500); 17 Sep 2015 09:38:27 -0000 Delivered-To: apmail-hadoop-yarn-dev-archive@hadoop.apache.org Received: (qmail 53660 invoked by uid 500); 17 Sep 2015 09:38:27 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-dev@hadoop.apache.org Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 53648 invoked by uid 99); 17 Sep 2015 09:38:27 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Sep 2015 09:38:27 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id DFBDCF37C9 for ; Thu, 17 Sep 2015 09:38:26 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.899 X-Spam-Level: ** X-Spam-Status: No, score=2.899 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H2=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id rlvUqyaFX-1l for ; Thu, 17 Sep 2015 09:38:20 +0000 (UTC) Received: from mail-io0-f180.google.com (mail-io0-f180.google.com [209.85.223.180]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 3F4EB42BA8 for ; Thu, 17 Sep 2015 09:38:20 +0000 (UTC) Received: by ioii196 with SMTP id i196so15731193ioi.3 for ; Thu, 17 Sep 2015 02:38:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=xd9/ClYw6frjMTyjZRN8VAP6SqTXjriv336xX60pQus=; b=p0+aFgw33SdR/t5TVmzMzea/50gAw+lFRWs8WevEsyZkVxsFWh8xrVh9PpVqc3DJJR RjABRcF0WdBuabETIMUkXCFv/beAVUkmMWgZw8yNveUuaqqD3VInj4KJE9h2qgZvqAIe n1/VKLFCQ04vB0syrEAEzSyh2B49jZdqt3kBpircscFbUDoCMq+hTNs+RQLwgB56+XL8 HUdEKmmoPoh9APX/RRLnTNvbr5yByCzUOm4XV00ijturK19UMxII064aYSIJEv1PLtOi XbjH80A5SBfVFXNJ/qCZwn75P+4fqmhpKuzV9YaLJcKTdc9oNbkVFM31QOlKv5WphpPR hgcA== MIME-Version: 1.0 X-Received: by 10.107.19.234 with SMTP id 103mr4826078iot.41.1442482699859; Thu, 17 Sep 2015 02:38:19 -0700 (PDT) Received: by 10.107.170.209 with HTTP; Thu, 17 Sep 2015 02:38:19 -0700 (PDT) Date: Thu, 17 Sep 2015 15:08:19 +0530 Message-ID: Subject: Concurrency control From: Laxman Ch To: yarn-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a113f7a92eb838f051fee2c39 --001a113f7a92eb838f051fee2c39 Content-Type: text/plain; charset=UTF-8 Hi, In YARN, do we have any way to control the amount of resources (vcores, memory) used by an application SIMULTANEOUSLY. - In my cluster, noticed some large and long running mr-app occupied all the slots of the queue and blocking other apps to get started. - I'm using Capacity schedulers (using hierarchical queues and preemption disabled) - Using Hadoop version 2.6.0 - Did some googling around this and gone through configuration docs but I'm not able to find anything that matches my requirement. If needed, I can provide more details on the usecase and problem. -- Thanks, Laxman --001a113f7a92eb838f051fee2c39--