Mailing-List: contact yarn-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Date: Thu, 1 Sep 2016 19:59:21 +0000 (UTC)
From: "Daniel Templeton (JIRA)" <jira@apache.org>
To: yarn-issues@hadoop.apache.org
Message-ID: <JIRA.13002161.1472759733000.472512.1472759961026@Atlassian.JIRA>
In-Reply-To: <JIRA.13002161.1472759733000@Atlassian.JIRA>
References: <JIRA.13002161.1472759733000@Atlassian.JIRA> <JIRA.13002161.1472759733466@arcas>
Subject: [jira] [Updated] (YARN-5613) Fair Scheduler can assign containers
 from blacklisted nodes
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 01 Sep 2016 19:59:22 -0000


     [ https://issues.apache.org/jira/browse/YARN-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Templeton updated YARN-5613:
-----------------------------------
    Attachment: YARN-5613.001.patch

The issue shows up when running {{TestAMRMClient.testAMRMClientWithBlacklist()}} using fair scheduler as the default.  The error is:

{noformat}
expected:<0> but was:<1>
Stacktrace

java.lang.AssertionError: expected:<0> but was:<1>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.testAllocationWithBlacklist(TestAMRMClient.java:537)
Standard Output
{noformat}

This patch appears to resolve the issue, but I'm still testing.

> Fair Scheduler can assign containers from blacklisted nodes
> -----------------------------------------------------------
>
>                 Key: YARN-5613
>                 URL: https://issues.apache.org/jira/browse/YARN-5613
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.8.0
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>         Attachments: YARN-5613.001.patch
>
>
> The {{FairScheduler.allocate()}} makes its resource request before it updates the blacklist.  If the scheduler processes the resource request before the allocating thread updates the blacklist, the scheduler can assign containers that are on nodes in the blacklist.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org