hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4047) ClientRMService getApplications has high scheduler lock contention
Date Wed, 09 Sep 2015 06:18:47 GMT

     [ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinod Kumar Vavilapalli updated YARN-4047:
------------------------------------------
    Fix Version/s: 2.6.1

Pulled this into 2.6.1. The patch applies cleanly. Ran compilation before the push.

> ClientRMService getApplications has high scheduler lock contention
> ------------------------------------------------------------------
>
>                 Key: YARN-4047
>                 URL: https://issues.apache.org/jira/browse/YARN-4047
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>              Labels: 2.6.1-candidate
>             Fix For: 2.6.1, 2.7.2
>
>         Attachments: YARN-4047.001.patch
>
>
> The getApplications call can be particuarly expensive because the code can call checkAccess
on every application being tracked by the RM.  checkAccess will often call scheduler.checkAccess
which will grab the big scheduler lock.  This can cause a lot of contention with the scheduler
thread which is busy trying to process node heartbeats, app allocation requests, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message