hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily
Date Tue, 14 Apr 2015 22:46:59 GMT

     [ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jason Lowe updated YARN-3487:
-----------------------------
    Attachment: YARN-3487.002.patch

We're also grabbing the scheduler lock in getQueue which just looks up the queue from the
concurrent hash map.  In addition checkAccess is locking to lookup the queue then invoke a
method on the queue.

Updated the patch to remove the lock on those two methods as well.

> CapacityScheduler scheduler lock obtained unnecessarily
> -------------------------------------------------------
>
>                 Key: YARN-3487
>                 URL: https://issues.apache.org/jira/browse/YARN-3487
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>    Affects Versions: 2.6.0
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>            Priority: Critical
>         Attachments: YARN-3487.001.patch, YARN-3487.002.patch
>
>
> Recently saw a significant slowdown of applications on a large cluster, and we noticed
there were a large number of blocked threads on the RM.  Most of the blocked threads were
waiting for the CapacityScheduler lock while calling getQueueInfo.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message