hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nathan Roberts (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable
Date Fri, 15 Apr 2016 15:28:25 GMT
Nathan Roberts created YARN-4963:
------------------------------------

             Summary: capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat
configurable
                 Key: YARN-4963
                 URL: https://issues.apache.org/jira/browse/YARN-4963
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: capacityscheduler
    Affects Versions: 2.7.2, 3.0.0
            Reporter: Nathan Roberts
            Assignee: Nathan Roberts


Currently the capacity scheduler will allow exactly 1 OFF_SWITCH assignment per heartbeat.
With more and more non MapReduce workloads coming along, the degree of locality is declining,
causing scheduling to be significantly slower. It's still important to limit the number of
OFF_SWITCH assignments to avoid densely packing OFF_SWITCH containers onto nodes. 

Proposal is to add a simple config that makes the number of OFF_SWITCH assignments configurable.

Will upload candidate patch shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message