hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ANANDA G B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9681) AM resource limit is incorrect for queue
Date Wed, 17 Jul 2019 14:16:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887083#comment-16887083

ANANDA G B commented on YARN-9681:

I have partition like below:


When we submit a app to queue1 in pool1, the LeafQueue.assignContainers function will update
cachedResourceLimitsForHeadroom to nodelabel pool1's resource 8196.

Then LeafQueue.activateApplications function calculate the 'Maximum Application Master Resources'
of DEFAULT_PARTITION using cachedResourceLimitsForHeadroom, which is wrong.

So, Each nodelabel should have its own cachedResourceLimitsForHeadroom. So it can be a ConcurrentHashMap
where key is nodelabel and value is ResourceLimits.

> AM resource limit is incorrect for queue
> ----------------------------------------
>                 Key: YARN-9681
>                 URL: https://issues.apache.org/jira/browse/YARN-9681
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 3.1.2
>            Reporter: ANANDA G B
>            Priority: Major
>         Attachments: After running job on queue1.png, Before running job on queue1.png
> After running the job on Queue1 of Partition1, then Queue1 of DEFAULT_PARTITION's 'Max
Application Master Resources' is calculated wrongly. Please find the attachement.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message