hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Yang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-8945) Calculation of maximum applications should respect specified and global maximum applications for absolute resource
Date Fri, 26 Oct 2018 02:20:00 GMT

     [ https://issues.apache.org/jira/browse/YARN-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tao Yang updated YARN-8945:
---------------------------
    Summary: Calculation of maximum applications should respect specified and global maximum
applications for absolute resource  (was: Calculation of Maximum applications should respect
specified and global maximum applications for absolute resource)

> Calculation of maximum applications should respect specified and global maximum applications
for absolute resource
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8945
>                 URL: https://issues.apache.org/jira/browse/YARN-8945
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>    Affects Versions: 3.2.0
>            Reporter: Tao Yang
>            Assignee: Tao Yang
>            Priority: Major
>
> Currently maximum applications is expected to be calculated as follow according to
priority when using percentage based capacity:
> (1) equals specified maximum applications for queues
> (2) equals global maximum applications
> (3) calculated as queue-capacity * maximum-system-applications
> But for absolute resource configuration, maximum applications is calculated as (3) in ParentQueue#deriveCapacityFromAbsoluteConfigurations,
this is a strict limit for high max-capacity and low capacity queues which have little guaranteed
resources but want to use lots of share resources. So I propose to share the maximum applications
calculation of percentage based capacity, absolute resource can call the same calculation
if necessary.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message