Return-Path: X-Original-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E0C4DD5B for ; Mon, 20 May 2013 04:29:20 +0000 (UTC) Received: (qmail 41161 invoked by uid 500); 20 May 2013 04:29:20 -0000 Delivered-To: apmail-hadoop-yarn-issues-archive@hadoop.apache.org Received: (qmail 41016 invoked by uid 500); 20 May 2013 04:29:18 -0000 Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-issues@hadoop.apache.org Delivered-To: mailing list yarn-issues@hadoop.apache.org Received: (qmail 40984 invoked by uid 99); 20 May 2013 04:29:17 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 May 2013 04:29:17 +0000 Date: Mon, 20 May 2013 04:29:17 +0000 (UTC) From: "Sandy Ryza (JIRA)" To: yarn-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (YARN-392) Make it possible to specify hard locality constraints in resource requests MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661767#comment-13661767 ] Sandy Ryza commented on YARN-392: --------------------------------- We currently have a working patch that has gone through multiple phases of review. This patch implements the proposal made by Arun on YARN-398, which many comments led me to believe we had consensus on. The approach enables whitelisting by setting a disable-allocation flag on certain requests, so some form of "blacklisting" is a natural extension of it. The changes to the scheduler are about 10 lines. Modifying the proposal to support *only* whitelisting would require many additional changes, and do nothing to simplify the current changes. As I said, if everyone else participating agrees on these additional changes, I am happy to implement them. But my opinion is that the best way to get this into 2.0.5, both in terms of soundness of the approach and in terms of punctuality, is to go with what we have worked on so far. > Make it possible to specify hard locality constraints in resource requests > -------------------------------------------------------------------------- > > Key: YARN-392 > URL: https://issues.apache.org/jira/browse/YARN-392 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Bikas Saha > Assignee: Sandy Ryza > Attachments: YARN-392-1.patch, YARN-392-2.patch, YARN-392-2.patch, YARN-392-2.patch, YARN-392-3.patch, YARN-392-4.patch, YARN-392.patch > > > Currently its not possible to specify scheduling requests for specific nodes and nowhere else. The RM automatically relaxes locality to rack and * and assigns non-specified machines to the app. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira