hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Payne (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations
Date Thu, 16 Nov 2017 20:27:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eric Payne updated YARN-7496:
-----------------------------
    Attachment: YARN-7496.001.branch-2.8.patch

Attaching a fix for branch-2.8. This change is in {{LeafQueue#computeUserLimit}}. It should
only affect preemption user limit calculations and should not affect assignment user limit
calculations.

Since it does touch the computations for user limit, I would really appreciate it if [~sunilg],
[~leftnoteasy], or [~jlowe] could take a look at it.

> CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit
calculations
> --------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-7496
>                 URL: https://issues.apache.org/jira/browse/YARN-7496
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.8.2
>            Reporter: Eric Payne
>            Assignee: Eric Payne
>         Attachments: YARN-7496.001.branch-2.8.patch
>
>
> Only a problem in 2.8.
> Preemption could oscillate due to the difference in how user limit is calculated between
2.8 and later releases.
> Basically (ignoring ULF, MULP, and maybe others), the calculation for user limit on the
Capacity Scheduler side in 2.8 is {{total used resources / number of active users}} while
the calculation in later releases is {{total active resources / number of active users}}.
When intra-queue preemption was backported to 2.8, it's calculations for user limit were more
aligned with the latter algorithm, which is in 2.9 and later releases.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message