hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bibin A Chundatt (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (YARN-3627) Preemption not triggered in Fair scheduler when maxResources is set on parent queue
Date Wed, 27 May 2015 08:33:18 GMT

     [ https://issues.apache.org/jira/browse/YARN-3627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Bibin A Chundatt resolved YARN-3627.
------------------------------------
    Resolution: Not A Problem

Closing this issue as per comments

> Preemption not triggered in Fair scheduler when maxResources is set on parent queue
> -----------------------------------------------------------------------------------
>
>                 Key: YARN-3627
>                 URL: https://issues.apache.org/jira/browse/YARN-3627
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: fairscheduler, scheduler
>         Environment: Suse 11 SP3, 2 NM 
>            Reporter: Bibin A Chundatt
>
> Consider the below scenario of fair configuration 
>  
> Root (10Gb cluster resource)
> --Q1 (maxResources  4gb) 
> ----Q1.1 (maxResources 4gb) 
> ----Q1.2  (maxResources  4gb)         
> --Q2 (maxResources 6GB)
>  
> No applications are running in Q2
>  
> Submit one application with to Q1.1 with 50 maps  & 4Gb gets allocated to Q1.1
> Now submit application to  Q1.2 the same will be starving for memory always.
>  
> Preemption will never get triggered since yarn.scheduler.fair.preemption.cluster-utilization-threshold
=.8 and the cluster utilization is below .8.
>  
> *Fairscheduler.java*
> {code}
>   private boolean shouldAttemptPreemption() {
>     if (preemptionEnabled) {
>       return (preemptionUtilizationThreshold < Math.max(
>           (float) rootMetrics.getAllocatedMB() / clusterResource.getMemory(),
>           (float) rootMetrics.getAllocatedVirtualCores() /
>               clusterResource.getVirtualCores()));
>     }
>     return false;
>   }
> {code}
> Are we supposed to configure in running cluster maxResources  <0mb and 0 cores >
so that all queues can take full cluster resources always if available??



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message