hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Craig Welch (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3306) [Umbrella] Proposing per-queue Policy driven scheduling in YARN
Date Wed, 13 May 2015 21:18:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542746#comment-14542746

Craig Welch commented on YARN-3306:

I don't think it's really necessary at this point, we've been careful to keep the integration
points narrow and controllable with configuration, as long as we continue to do that I don't
think we need the separation of a branch.

> [Umbrella] Proposing per-queue Policy driven scheduling in YARN
> ---------------------------------------------------------------
>                 Key: YARN-3306
>                 URL: https://issues.apache.org/jira/browse/YARN-3306
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: scheduler
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>         Attachments: PerQueuePolicydrivenschedulinginYARN.pdf
> Scheduling layout in Apache Hadoop YARN today is very coarse grained. This proposal aims
at converting today’s rigid scheduling in YARN to a per­-queue policy driven architecture.
> We propose the creation of a c​ommon policy framework​ and implement a​common set
of policies​ that administrators can pick and chose per queue
>  - Make scheduling policies configurable per queue
>  - Initially, we limit ourselves to a new type of scheduling policy that determines the
ordering of applications within the l​eaf ­queue
>  - In the near future, we will also pursue parent­ queue level policies and potential
algorithm reuse through a separate type of policies that control resource limits per queue,
user, application etc.

This message was sent by Atlassian JIRA

View raw message