hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Junping Du (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations
Date Tue, 05 Dec 2017 00:26:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277801#comment-16277801
] 

Junping Du commented on YARN-7496:
----------------------------------

Merge to branch-2.8.3 given we previously set fix version to 2.8.3.

> CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit
calculations
> --------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-7496
>                 URL: https://issues.apache.org/jira/browse/YARN-7496
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.8.2
>            Reporter: Eric Payne
>            Assignee: Eric Payne
>             Fix For: 2.8.3
>
>         Attachments: YARN-7496.001.branch-2.8.patch
>
>
> Only a problem in 2.8.
> Preemption could oscillate due to the difference in how user limit is calculated between
2.8 and later releases.
> Basically (ignoring ULF, MULP, and maybe others), the calculation for user limit on the
Capacity Scheduler side in 2.8 is {{total used resources / number of active users}} while
the calculation in later releases is {{total active resources / number of active users}}.
When intra-queue preemption was backported to 2.8, it's calculations for user limit were more
aligned with the latter algorithm, which is in 2.9 and later releases.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message