hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Payne (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue
Date Mon, 11 Apr 2016 18:02:25 GMT

    [ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235611#comment-15235611
] 

Eric Payne commented on YARN-2113:
----------------------------------

{quote}
Vinod Kumar Vavilapalli, have you had any chance to think about the implementation for this
feature (in-queue preemption). We are seeing cases where we have an ad-hoc queue that many
people can use, bu long-running containers are using up many resources in that queue and keeping
other users' apps from starting.
{quote}
[~leftnoteasy] / [~vinodkv], IIUC, the new infrastructure created by YARN-4822 would be used
and a new "intra-queue fairness policy" would be provided, correct? If so, is there someone
currently working on the "intra-queue fairness policy?"

> Add cross-user preemption within CapacityScheduler's leaf-queue
> ---------------------------------------------------------------
>
>                 Key: YARN-2113
>                 URL: https://issues.apache.org/jira/browse/YARN-2113
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: scheduler
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>
> Preemption today only works across queues and moves around resources across queues per
demand and usage. We should also have user-level preemption within a queue, to balance capacity
across users in a predictable manner.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message