hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Muhammad Samir Khan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-6834) A container request with only racks specified and relax locality set to false is never honoured
Date Mon, 17 Jul 2017 22:08:00 GMT
Muhammad Samir Khan created YARN-6834:
-----------------------------------------

             Summary: A container request with only racks specified and relax locality set
to false is never honoured
                 Key: YARN-6834
                 URL: https://issues.apache.org/jira/browse/YARN-6834
             Project: Hadoop YARN
          Issue Type: Bug
          Components: capacity scheduler
            Reporter: Muhammad Samir Khan


A patch for a unit test is attached to reproduce the issue. It creates a container request
with only racks specified (nodes=null) and relax locality set to false. With the node-locality-delay
conf set appropriately, we wait indefinitely for a container allocation and the test will
timeout.

My understanding of what causes this issue is as follows. The RegularContainerAllocator delays
a rack local allocation based on the node-locality-delay parameter. This delay is based on
missed opportunities. However, the corresponding off-switch request is skipped but does not
count towards a missed opportunity (because relax locality is set to false). So the allocator
waits indefinitely.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message