hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-4047) ClientRMService getApplications has high scheduler lock contention
Date Tue, 11 Aug 2015 19:51:46 GMT
Jason Lowe created YARN-4047:
--------------------------------

             Summary: ClientRMService getApplications has high scheduler lock contention
                 Key: YARN-4047
                 URL: https://issues.apache.org/jira/browse/YARN-4047
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager
            Reporter: Jason Lowe


The getApplications call can be particuarly expensive because the code can call checkAccess
on every application being tracked by the RM.  checkAccess will often call scheduler.checkAccess
which will grab the big scheduler lock.  This can cause a lot of contention with the scheduler
thread which is busy trying to process node heartbeats, app allocation requests, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message