hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karthik Kambatla (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share
Date Sat, 16 Aug 2014 00:24:19 GMT

    [ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099392#comment-14099392

Karthik Kambatla commented on YARN-2393:

bq. Should we bound maxAMResource by steady fair share instead, which doesn't fluctuate? 
If we use steady fairshare, creating many queues can lead to not having enough resources to
run an AM. Using instantaneous fairshare doesn't let this happen. However, it is possible
that the amShare becomes greater than what it should be for a potentially lower instantaneous
fairshare at a later time. We could preempt AM containers as well, but need to tread this
very carefully. 

> Fair Scheduler : Implement steady fair share
> --------------------------------------------
>                 Key: YARN-2393
>                 URL: https://issues.apache.org/jira/browse/YARN-2393
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: fairscheduler
>            Reporter: Ashwin Shankar
>            Assignee: Wei Yan
>         Attachments: YARN-2393-1.patch, YARN-2393-2.patch, YARN-2393-3.patch
> Static fair share is a fair share allocation considering all(active/inactive) queues.It
would be shown on the UI for better predictability of finish time of applications.
> We would compute static fair share only when needed, like on queue creation, node added/removed.
Please see YARN-2026 for discussions on this. 

This message was sent by Atlassian JIRA

View raw message