hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request
Date Wed, 27 Aug 2014 01:42:57 GMT

    [ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111724#comment-14111724
] 

Karthik Kambatla commented on YARN-2154:
----------------------------------------

Started looking into this. Today, we just look at the amount of resources to be preempted.
Instead, we should collect a list of applications for which we are preempting containers.
Iterate through these applications and their ResourceRequests to find potential matches in
free resources and subsequently in resources assigned to another application that is over
its fairshare. 

Will post a patch for this once YARN-2395 and YARN-2394 get committed. 

> FairScheduler: Improve preemption to preempt only those containers that would satisfy
the incoming request
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2154
>                 URL: https://issues.apache.org/jira/browse/YARN-2154
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>    Affects Versions: 2.4.0
>            Reporter: Karthik Kambatla
>            Assignee: Karthik Kambatla
>            Priority: Critical
>
> Today, FairScheduler uses a spray-gun approach to preemption. Instead, it should only
preempt resources that would satisfy the incoming request. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message