hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ANANDA G B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9681) AM resource limit is incorrect for queue
Date Wed, 17 Jul 2019 14:18:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887084#comment-16887084
] 

ANANDA G B commented on YARN-9681:
----------------------------------

When we submit a app to queue1 in pool1 (Please check the attached screenshots for nodelabels
configuration), the LeafQueue.assignContainers function will update cachedResourceLimitsForHeadroom
to nodelabel pool1's resource 8196.


Then LeafQueue.activateApplications function calculate the 'Maximum Application Master Resources'
of DEFAULT_PARTITION using cachedResourceLimitsForHeadroom. This is wrong actually.


So, each nodelabel should have its own cachedResourceLimitsForHeadroom. So it can be a ConcurrentHashMap
where key is nodelabel and value is ResourceLimits.

> AM resource limit is incorrect for queue
> ----------------------------------------
>
>                 Key: YARN-9681
>                 URL: https://issues.apache.org/jira/browse/YARN-9681
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 3.1.2
>            Reporter: ANANDA G B
>            Priority: Major
>         Attachments: After running job on queue1.png, Before running job on queue1.png
>
>
> After running the job on Queue1 of Partition1, then Queue1 of DEFAULT_PARTITION's 'Max
Application Master Resources' is calculated wrongly. Please find the attachement.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message