hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Payne (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations
Date Tue, 14 Nov 2017 22:43:00 GMT
Eric Payne created YARN-7496:
--------------------------------

             Summary: CS Intra-queue preemption user-limit calculations are not in line with
LeafQueue user-limit calculations
                 Key: YARN-7496
                 URL: https://issues.apache.org/jira/browse/YARN-7496
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 2.8.2
            Reporter: Eric Payne
            Assignee: Eric Payne


Only a problem in 2.8.

Preemption could oscillate due to the difference in how user limit is calculated between 2.8
and later releases.

Basically (ignoring ULF, MULP, and maybe others), the calculation for user limit on the Capacity
Scheduler side in 2.8 is {{total used resources / number of active users}} while the calculation
in later releases is {{total active resources / number of active users}}. When intra-queue
preemption was backported to 2.8, it's calculations for user limit were more aligned with
the latter algorithm, which is in 2.9 and later releases.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message