hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6231) DFSClient hangs infinitely if using hedged reads and all eligible datanodes die.
Date Fri, 11 Apr 2014 11:23:18 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966406#comment-13966406
] 

Hudson commented on HDFS-6231:
------------------------------

SUCCESS: Integrated in Hadoop-Yarn-trunk #537 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/537/])
HDFS-6231. DFSClient hangs infinitely if using hedged reads and all eligible datanodes die.
Contributed by Chris Nauroth. (cnauroth: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1586551)
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestPread.java


> DFSClient hangs infinitely if using hedged reads and all eligible datanodes die.
> --------------------------------------------------------------------------------
>
>                 Key: HDFS-6231
>                 URL: https://issues.apache.org/jira/browse/HDFS-6231
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs-client
>    Affects Versions: 3.0.0, 2.4.0
>            Reporter: Chris Nauroth
>            Assignee: Chris Nauroth
>             Fix For: 3.0.0, 2.4.1
>
>         Attachments: HDFS-6231.1.patch
>
>
> When using hedged reads, and all eligible datanodes for the read get flagged as dead
or ignored, then the client is supposed to refetch block locations from the NameNode to retry
the read.  Instead, we've seen that the client can hang indefinitely.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message