hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tao Jie (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4333) Fair scheduler should support preemption within queue
Date Thu, 05 Nov 2015 03:29:27 GMT
Tao Jie created YARN-4333:

             Summary: Fair scheduler should support preemption within queue
                 Key: YARN-4333
                 URL: https://issues.apache.org/jira/browse/YARN-4333
             Project: Hadoop YARN
          Issue Type: Bug
          Components: fairscheduler
            Reporter: Tao Jie

Now each app in fair scheduler is allocated its fairshare, however  fairshare resource is
not ensured even if fairSharePreemption is enabled.
1, When the cluster is idle, we submit app1 to queueA,which takes maxResource of queueA. 

2, Then the cluster becomes busy, but app1 does not release any resource, queueA resource
usage is over its fairshare
3, Then we submit app2(maybe with higher priority) to queueA. Now app2 has its own fairshare,
but could not obtain any resource, since queueA is still over its fairshare and resource will
not assign to queueA anymore. Also, preemption is not triggered in this case.
So we should allow preemption within queue, when app is starved for fairshare.

This message was sent by Atlassian JIRA

View raw message