hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Payne (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2056) Disable preemption at Queue level
Date Thu, 14 Aug 2014 16:50:13 GMT

    [ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097194#comment-14097194
] 

Eric Payne commented on YARN-2056:
----------------------------------

{quote}
Could this be accomplished by changing {{yarn.resourcemanager.monitor.capacity.preemption.max_ignored_over_capacity}}
to be a per-queue value. Then for queues that we don't ever want to be preempted, we set {{max_ignored_over_capacity
== (max_capacity/capacity)-1.0}}?

Vinod, the motivation from my perspective is that we need a way to gradually phase in preemption
and so being able to configure the queues in a way that prevents and/or gradually allows preemption
seems desirable.
{quote}

[~nroberts], [~mayank_bansal], and [~vinodkv],

Would the {{max_ignored_over_capacity}} property become something like {{yarn.resourcemanager.monitor.capacity.preemption.<queue-path>.max_ignored_over_capacity}}?

For example, if the capacity scheduler were configured with 2 leaf queues, {{excalibur}} and
{{brisingr}}, I would imagine that the {{max_ignored_over_capacity}} property name would look
like this:

{{yarn.resourcemanager.monitor.capacity.preemption.root.excalibur.max_ignored_over_capacity}}
{{yarn.resourcemanager.monitor.capacity.preemption.root.brisingr.max_ignored_over_capacity}}

> Disable preemption at Queue level
> ---------------------------------
>
>                 Key: YARN-2056
>                 URL: https://issues.apache.org/jira/browse/YARN-2056
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager
>    Affects Versions: 2.4.0
>            Reporter: Mayank Bansal
>            Assignee: Eric Payne
>
> We need to be able to disable preemption at individual queue level



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message