hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2213) DataNode gets stuck while shutting down minicluster
Date Tue, 02 Aug 2011 11:43:29 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13076143#comment-13076143
] 

Steve Loughran commented on HDFS-2213:
--------------------------------------

I'll add that this problem may well exist in production DataNodes too, as it is its shutdown
code that is blocking. It's just surfacing in the minicluster as this terminates more datanodes
in a test run

> DataNode gets stuck while shutting down minicluster
> ---------------------------------------------------
>
>                 Key: HDFS-2213
>                 URL: https://issues.apache.org/jira/browse/HDFS-2213
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: data-node
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>             Fix For: 0.23.0
>
>         Attachments: stack.txt
>
>
> I've seen a couple times where a unit test has timed out. jstacking shows the cluster
is stuck trying to shut down one of the DataNode HTTP servers. The DataNodeBlockScanner thread
also seems to be in a tight loop in its main loop.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message