hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues
Date Fri, 17 Nov 2017 23:06:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257722#comment-16257722

Wangda Tan commented on YARN-7473:

Thanks [~suma.shivaprasad], comments: 

1) Should be part of ManagedParentQueue instead of CS.
2) Instead of using QueueEntitlement, can we use LeafQueueTemplate and reinitialize LeafQueue?

1) ordering looks wrong:
2) getInitialEntitlement should be getInitialQueueTemplate and merged to queue creation path.

1) Should it part of ManagedParentQueue?

1) Can we just let policy pull child queues info from parent queue reference? 

AutoCreatedQueueManagementPolicy#reinitialize not being used.

AutoCreatedQueueManagementPolicy#init, clock can be removed from parameter list.

> Implement Framework and policy for capacity management of auto created queues 
> ------------------------------------------------------------------------------
>                 Key: YARN-7473
>                 URL: https://issues.apache.org/jira/browse/YARN-7473
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacity scheduler
>            Reporter: Suma Shivaprasad
>            Assignee: Suma Shivaprasad
>         Attachments: YARN-7473.1.patch, YARN-7473.2.patch
> This jira mainly addresses the following
> 1.Support adding pluggable policies on parent queue for dynamically managing capacity/state
for leaf queues.
> 2. Implement  a default policy that manages capacity based on pending applications and
either grants guaranteed or zero capacity to queues based on parent's available guaranteed
> 3. Integrate with SchedulingEditPolicy framework to trigger this periodically and signal
scheduler to take necessary actions for capacity/queue management.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message