hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sunil G (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues
Date Thu, 25 Jun 2015 16:17:04 GMT
Sunil G created YARN-3849:
-----------------------------

             Summary: Too much of preemption activity causing continuos killing of containers
across queues
                 Key: YARN-3849
                 URL: https://issues.apache.org/jira/browse/YARN-3849
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager
    Affects Versions: 2.7.0
            Reporter: Sunil G
            Assignee: Sunil G
            Priority: Critical


Two queues are used. Each queue has given a capacity of 0.5. Dominant Resource policy is used.

1. An app is submitted in QueueA which is consuming full cluster capacity
2. After submitting an app in QueueB, there are some demand  and invoking preemption in QueueA
3. Instead of killing the excess of 0.5 guaranteed capacity, we observed that all containers
other than AM is getting killed in QueueA
4. Now the app in QueueB is trying to take over cluster with the current free space. But there
are some updated demand from the app in QueueA which lost its containers earlier, and preemption
is kicked in QueueB now.

Scenario in step 3 and 4 continuously happening in loop. Thus none of the apps are completing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message