hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request
Date Sat, 15 Aug 2015 08:24:46 GMT

    [ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698178#comment-14698178
] 

Karthik Kambatla commented on YARN-2154:
----------------------------------------

[~bpodgursky] - I was only observing what the patch seems to be doing. 

The patch prioritizes currently running apps over pending apps. The pending apps aren't necessarily
starved - subsequent preemptions should handle them. [~asuresh] - could you please confirm
the same. If this is not the case, I agree with [~bpodgursky] that we shouldn't starve small
apps. 



> FairScheduler: Improve preemption to preempt only those containers that would satisfy
the incoming request
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-2154
>                 URL: https://issues.apache.org/jira/browse/YARN-2154
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>    Affects Versions: 2.4.0
>            Reporter: Karthik Kambatla
>            Assignee: Arun Suresh
>            Priority: Critical
>         Attachments: YARN-2154.1.patch
>
>
> Today, FairScheduler uses a spray-gun approach to preemption. Instead, it should only
preempt resources that would satisfy the incoming request. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message