hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kihwal Lee (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5522) Datanode disk error check may be incorrectly skipped
Date Fri, 15 Nov 2013 22:23:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13824173#comment-13824173
] 

Kihwal Lee commented on HDFS-5522:
----------------------------------

An option will be to move the check to a new or existing thread and decouple checks from request
handling.

> Datanode disk error check may be incorrectly skipped
> ----------------------------------------------------
>
>                 Key: HDFS-5522
>                 URL: https://issues.apache.org/jira/browse/HDFS-5522
>             Project: Hadoop HDFS
>          Issue Type: Bug
>    Affects Versions: 0.23.9, 2.2.0
>            Reporter: Kihwal Lee
>             Fix For: 2.3.0, 0.23.11
>
>
> After HDFS-4581 and HDFS-4699, {{checkDiskError()}} is not called when network errors
occur during processing data node requests.  This appears to create problems when a disk is
having problems, but not failing I/O soon. 
> If I/O hangs for a long time, network read/write may timeout first and the peer may close
the connection. Although the error was caused by a faulty local disk, disk check is not being
carried out in this case. 



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message