hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Carlo Curino (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-5435) [Regression] QueueCapacities not being updated for dynamic ReservationQueue
Date Fri, 28 Oct 2016 00:36:58 GMT

    [ https://issues.apache.org/jira/browse/YARN-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613799#comment-15613799

Carlo Curino commented on YARN-5435:

[~seanpo03] what you have makes sense to me, but it is mostly overlapping with YARN-4003 (which
I close as duplicate of this). What you are missing here, which should be added is the setting
(via overriding) of the {{getAMResourceLimit()}} and {{getUserAMResourceLimit()}}. For {{ReservationQueue}}
(as we discuss YARN-4003) this limit should be set independently of the local capacity and
be set to the value of the parent (as  the reservation capacity will fluctuate heavily, hitting
zero at times). Look at the patch i had in YARN-4003 and import in your one similar functionalities.

> [Regression] QueueCapacities not being updated for dynamic ReservationQueue
> ---------------------------------------------------------------------------
>                 Key: YARN-5435
>                 URL: https://issues.apache.org/jira/browse/YARN-5435
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler, resourcemanager
>    Affects Versions: 2.8.0
>            Reporter: Sean Po
>            Assignee: Sean Po
>              Labels: oct16-easy, regression
>         Attachments: YARN-5435.v003.patch, YARN-5435.v1.patch, YARN-5435.v2.patch
> YARN-1707 added dynamic queues (ReservationQueue) to CapacityScheduler. The QueueCapacities
data structure was added subsequently but is not being updated correctly for ReservationQueue.
This JIRA tracks the changes required to update QueueCapacities of ReservationQueue correctly.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message