hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ANANDA G B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9681) AM resource limit is incorrect for queue
Date Wed, 17 Jul 2019 14:16:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887083#comment-16887083
] 

ANANDA G B commented on YARN-9681:
----------------------------------

I have partition like below:

!image-2019-07-17-19-43-16-718.png!

When we submit a app to queue1 in pool1, the LeafQueue.assignContainers function will update
cachedResourceLimitsForHeadroom to nodelabel pool1's resource 8196.


Then LeafQueue.activateApplications function calculate the 'Maximum Application Master Resources'
of DEFAULT_PARTITION using cachedResourceLimitsForHeadroom, which is wrong.


So, Each nodelabel should have its own cachedResourceLimitsForHeadroom. So it can be a ConcurrentHashMap
where key is nodelabel and value is ResourceLimits.

> AM resource limit is incorrect for queue
> ----------------------------------------
>
>                 Key: YARN-9681
>                 URL: https://issues.apache.org/jira/browse/YARN-9681
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 3.1.2
>            Reporter: ANANDA G B
>            Priority: Major
>         Attachments: After running job on queue1.png, Before running job on queue1.png
>
>
> After running the job on Queue1 of Partition1, then Queue1 of DEFAULT_PARTITION's 'Max
Application Master Resources' is calculated wrongly. Please find the attachement.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message