hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy
Date Thu, 14 Jan 2016 06:34:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097704#comment-15097704
] 

Wangda Tan commented on YARN-2009:
----------------------------------

Hi [~sunilg]/[~eepayne].

I was thinking YARN-4108 could resolve it. But I found the original plan (see design doc v2)
is not a doable plan in a short term. I uploaded v3 only handles part of the original issue
(avoid unnecessary preemption happens), and leaves how to select to-be preempted containers
as-is.

If you have time, could you take a look at latest proposal of YARN-4108. I think how to choose
to-be preempted containers should be handled inside PCPP by different policies. We've put
too many logics (like sorted by FIFO order, not preempt AM container, etc) to PCPP, maybe
it's time to cleanup them to a better form. 

> Priority support for preemption in ProportionalCapacityPreemptionPolicy
> -----------------------------------------------------------------------
>
>                 Key: YARN-2009
>                 URL: https://issues.apache.org/jira/browse/YARN-2009
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler
>            Reporter: Devaraj K
>            Assignee: Sunil G
>
> While preempting containers based on the queue ideal assignment, we may need to consider
preempting the low priority application containers first.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message