hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-3519) Deadlock in LocalDirsHandlerService and ShuffleHandler
Date Fri, 09 Dec 2011 23:30:40 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166664#comment-13166664

Hudson commented on MAPREDUCE-3519:

Integrated in Hadoop-Hdfs-0.23-Commit #256 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/256/])
    MAPREDUCE-3519. Fixed a deadlock in NodeManager LocalDirectories's handling service. Contributed
by Ravi Gummadi.
svn merge -c 1212680 --ignore-ancestry ../../trunk

vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1212681
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LocalDirsHandlerService.java

> Deadlock in LocalDirsHandlerService and ShuffleHandler
> ------------------------------------------------------
>                 Key: MAPREDUCE-3519
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3519
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, nodemanager
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>            Priority: Blocker
>             Fix For: 0.23.1
>         Attachments: 3519.patch, 3519.v1.patch, deadlock.txt
> MAPREDUCE-3121 cloned Configuration object in LocalDirsHandlerService.init() to avoid
others to access that configuration object. But since it is used in local FileSystem object
creation in LocalDirAllocator.AllocatorPerContext and the same FileSystem object is used in
ShuffleHandler.Shuffle.localDirAllocator, this is causing a deadlock when accessing this configuration
object from LocalDirsHandlerService and ShuffleHandler along with AllocatorPerContext object.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message