Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 13 Feb 2017 12:10:41 +0000 (UTC)
From: "Varun Saxena (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13040963.1486471230000.62346.1486987841751@Atlassian.JIRA>
In-Reply-To: <JIRA.13040963.1486471230000@Atlassian.JIRA>
References: <JIRA.13040963.1486471230000@Atlassian.JIRA> <JIRA.13040963.1486471230146@jira-lw-us.apache.org>
Subject: [jira] [Comment Edited] (YARN-6156) AM blacklistdisableThreshold
  consider node partition count
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 13 Feb 2017 12:21:23 -0000


    [ https://issues.apache.org/jira/browse/YARN-6156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15863485#comment-15863485 ] 

Varun Saxena edited comment on YARN-6156 at 2/13/17 12:10 PM:
--------------------------------------------------------------

bq. And again AM container is allocated in another non-exclusive node. So we are now +2 from old node count, correct?
We should only add this node(i.e. count it towards NM count) and not remove it when AM containers fail then. Will be somewhat difficult to pass. Maybe update it when RMContainer is created or take the label from RMContainer and update it when attempt gets to know about the container. 
And a similar thing will have to be done in YARN-6148 if we do consider non exclusive labels this way.


was (Author: varun_saxena):
bq. And again AM container is allocated in another non-exclusive node. So we are now +2 from old node count, correct?
We should only add this node(i.e. count it towards NM count) and not remove it when AM containers fail then. Will be somewhat difficult to pass. Maybe update it when RMContainer is created. 
And a similar thing will have to be done in YARN-6148 if we do consider non exclusive labels this way.

> AM blacklistdisableThreshold  consider node partition count
> -----------------------------------------------------------
>
>                 Key: YARN-6156
>                 URL: https://issues.apache.org/jira/browse/YARN-6156
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Bibin A Chundatt
>            Assignee: Bibin A Chundatt
>         Attachments: YARN-6156.0001.patch, YARN-6156.0002.patch
>
>
> As per the current implementation for AM blacklisting disabling is based on completed custer resource.
> Incase of partitioned cluster, nodes applicable for AM labels only should be considered as total nodes.


--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org