hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3508) Preemption processing occuring on the main RM dispatcher
Date Mon, 20 Apr 2015 16:04:58 GMT
Jason Lowe created YARN-3508:

             Summary: Preemption processing occuring on the main RM dispatcher
                 Key: YARN-3508
                 URL: https://issues.apache.org/jira/browse/YARN-3508
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager, scheduler
    Affects Versions: 2.6.0
            Reporter: Jason Lowe

We recently saw the RM for a large cluster lag far behind on the AsyncDispacher event queue.
 The AsyncDispatcher thread was consistently blocked on the highly-contended CapacityScheduler
lock trying to dispatch preemption-related events for RMContainerPreemptEventDispatcher. 
Preemption processing should occur on the scheduler event dispatcher thread or a separate
thread to avoid delaying the processing of other events in the primary dispatcher queue.

This message was sent by Atlassian JIRA

View raw message