hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zian Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied
Date Thu, 26 Jul 2018 20:58:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zian Chen updated YARN-8509:
----------------------------
    Description: 
In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending resource
based on user-limit percent and user-limit factor which will cap pending resource for each
user to the minimum of user-limit pending and actual pending. This will prevent queue from
taking more pending resource to achieve queue balance after all queue satisfied with its ideal
allocation.
  
 We need to change the logic to let queue pending can go beyond userlimit.

  was:
In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending resource
based on user-limit percent and user-limit factor which will cap pending resource for each
user to the minimum of user-limit pending and actual pending. This will prevent queue from
taking more pending resource to achieve queue balance after all queue satisfied with its ideal
allocation.
 
We need to change the logic to let queue pending can reach at most (Queue_max_capacity - Queue_used_capacity).


> Fix UserLimit calculation for preemption to balance scenario after queue satisfied  
> ------------------------------------------------------------------------------------
>
>                 Key: YARN-8509
>                 URL: https://issues.apache.org/jira/browse/YARN-8509
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: yarn
>            Reporter: Zian Chen
>            Assignee: Zian Chen
>            Priority: Major
>         Attachments: YARN-8509.001.patch
>
>
> In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending
resource based on user-limit percent and user-limit factor which will cap pending resource
for each user to the minimum of user-limit pending and actual pending. This will prevent
queue from taking more pending resource to achieve queue balance after all queue satisfied
with its ideal allocation.
>   
>  We need to change the logic to let queue pending can go beyond userlimit.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message