hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue
Date Mon, 25 Jul 2016 10:29:20 GMT

    [ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391671#comment-15391671

Sunil G commented on YARN-4945:

Thanks [~eepayne] and [~leftnoteasy]

Yes, I was working on a POC patch for this and I could share an initial design doc for same.
It will be really great if  we can collaborate. Since intra-queue preemption may need to consider
multiple factors such 
- Priority
- Fairness 
- User limit

my plan was to do the basic intra-queue preemption framework which can work along (or reuse)
with existing PCPP mode. To this framework, we can add policies mentioned above. For initial
POC, I was planning *priority* as I have done an independent POC for priority preemption alone.
It will be great if we could also add policies like *user limit* , *fairness* etc.

I will share an initial document in a short while, so we could discuss more and improve the

> [Umbrella] Capacity Scheduler Preemption Within a queue
> -------------------------------------------------------
>                 Key: YARN-4945
>                 URL: https://issues.apache.org/jira/browse/YARN-4945
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Wangda Tan
> This is umbrella ticket to track efforts of preemption within a queue to support features
> YARN-2009. YARN-2113. YARN-4781.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org

View raw message