hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Templeton (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-5613) Fair Scheduler can assign containers from blacklisted nodes
Date Thu, 01 Sep 2016 19:59:21 GMT

     [ https://issues.apache.org/jira/browse/YARN-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Daniel Templeton updated YARN-5613:
    Attachment: YARN-5613.001.patch

The issue shows up when running {{TestAMRMClient.testAMRMClientWithBlacklist()}} using fair
scheduler as the default.  The error is:

expected:<0> but was:<1>

java.lang.AssertionError: expected:<0> but was:<1>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.yarn.client.api.impl.TestAMRMClient.testAllocationWithBlacklist(TestAMRMClient.java:537)
Standard Output

This patch appears to resolve the issue, but I'm still testing.

> Fair Scheduler can assign containers from blacklisted nodes
> -----------------------------------------------------------
>                 Key: YARN-5613
>                 URL: https://issues.apache.org/jira/browse/YARN-5613
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler
>    Affects Versions: 2.8.0
>            Reporter: Daniel Templeton
>            Assignee: Daniel Templeton
>         Attachments: YARN-5613.001.patch
> The {{FairScheduler.allocate()}} makes its resource request before it updates the blacklist.
 If the scheduler processes the resource request before the allocating thread updates the
blacklist, the scheduler can assign containers that are on nodes in the blacklist.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message