hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-325) RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing
Date Wed, 09 Jan 2013 15:34:12 GMT

    [ https://issues.apache.org/jira/browse/YARN-325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13548576#comment-13548576
] 

Thomas Graves commented on YARN-325:
------------------------------------

Thanks Arun! This is what we were thinking too.  The code looks good. I'm going to run through
gridmix to excercise some of the reservation cases a bit and if that looks good will commit.


I've merged this to branch-0.23 also and will attach that patch for reference.
                
> RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing
> ---------------------------------------------------------------------------------------------
>
>                 Key: YARN-325
>                 URL: https://issues.apache.org/jira/browse/YARN-325
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacityscheduler
>    Affects Versions: 2.0.2-alpha, 0.23.5
>            Reporter: Jason Lowe
>            Assignee: Arun C Murthy
>            Priority: Blocker
>         Attachments: YARN-325.patch, YARN-325.patch
>
>
> If a client calls getQueueInfo on a parent queue (e.g.: the root queue) and containers
are completing then the RM can deadlock.  getQueueInfo() locks the ParentQueue and then calls
the child queues' getQueueInfo() methods in turn.  However when a container completes, it
locks the LeafQueue then calls back into the ParentQueue.  When the two mix, it's a recipe
for deadlock.
> Stacktrace to follow.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message