hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Templeton (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-5613) Fair Scheduler can assign containers from blacklisted nodes
Date Thu, 01 Sep 2016 19:59:21 GMT

     [ https://issues.apache.org/jira/browse/YARN-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Templeton updated YARN-5613:
-----------------------------------
    Attachment: YARN-5613.001.patch

The issue shows up when running {{TestAMRMClient.testAMRMClientWithBlacklist()}} using fair
scheduler as the default.  The error is:

{noformat}
expected:<0> but was:<1>
Stacktrace

java.lang.AssertionError: expected:<0> but was:<1>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.testAllocationWithBlacklist(TestAMRMClient.java:537)
Standard Output
{noformat}

This patch appears to resolve the issue, but I'm still testing.

> Fair Scheduler can assign containers from blacklisted nodes
> -----------------------------------------------------------
>
>                 Key: YARN-5613
>                 URL: https://issues.apache.org/jira/browse/YARN-5613
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.8.0
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>         Attachments: YARN-5613.001.patch
>
>
> The {{FairScheduler.allocate()}} makes its resource request before it updates the blacklist.
 If the scheduler processes the resource request before the allocating thread updates the
blacklist, the scheduler can assign containers that are on nodes in the blacklist.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message