hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Shah (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-4047) ClientRMService getApplications has high scheduler lock contention
Date Tue, 11 Aug 2015 20:45:47 GMT

     [ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Hitesh Shah updated YARN-4047:
    Labels: 2.6.1-candidate  (was: )

> ClientRMService getApplications has high scheduler lock contention
> ------------------------------------------------------------------
>                 Key: YARN-4047
>                 URL: https://issues.apache.org/jira/browse/YARN-4047
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>              Labels: 2.6.1-candidate
>         Attachments: YARN-4047.001.patch
> The getApplications call can be particuarly expensive because the code can call checkAccess
on every application being tracked by the RM.  checkAccess will often call scheduler.checkAccess
which will grab the big scheduler lock.  This can cause a lot of contention with the scheduler
thread which is busy trying to process node heartbeats, app allocation requests, etc.

This message was sent by Atlassian JIRA

View raw message