hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-54) datanode not failing when read-only filesystem
Date Mon, 21 Nov 2011 12:52:52 GMT

    [ https://issues.apache.org/jira/browse/HDFS-54?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13154138#comment-13154138
] 

Harsh J commented on HDFS-54:
-----------------------------

Although there is a check in BlockReceiver<init> now for disk errors upon IOE, it seems
to be limited to errors that only go like:

"Possible disk error on file creation:"

I guess this is hence still not covered today.

Should we get rid of this check, and simply issue disk error checks each time we plainly hit
an IOE? Other places do this directly, but perhaps for the constructor here its too expensive
to.
                
> datanode not failing when read-only filesystem
> ----------------------------------------------
>
>                 Key: HDFS-54
>                 URL: https://issues.apache.org/jira/browse/HDFS-54
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>            Priority: Minor
>
> (This is not directly related to dfs -put hanging, but thought it should get fixed.)
> Datanode is catching IOException but not shutting itself down.
> 2008-02-02 00:10:24,237 ERROR org.apache.hadoop.dfs.DataNode: DataXceiver: java.io.IOException:
Read-only file system
>         at java.io.UnixFileSystem.createFileExclusively(Native Method)
>         at java.io.File.createNewFile(File.java:883)
>         at org.apache.hadoop.dfs.FSDataset$FSVolume.createTmpFile(FSDataset.java:329)
>         at org.apache.hadoop.dfs.FSDataset.createTmpFile(FSDataset.java:606)
>         at org.apache.hadoop.dfs.FSDataset.writeToBlock(FSDataset.java:582)
>         at org.apache.hadoop.dfs.DataNode$BlockReceiver.<init>(DataNode.java:1257)
>         at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:901)
>         at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:804)
>         at java.lang.Thread.run(Thread.java:619)
> 2008-02-02 00:16:29,996 INFO org.apache.hadoop.dfs.DataNode: Received block blk_-7723120264171092160
from /11.11.11.11
> 2008-02-02 00:41:40,409 INFO org.apache.hadoop.dfs.DataNode: Received block blk_1939877544554342517
from /22.22.22.22
> 2008-02-02 00:46:53,925 INFO org.apache.hadoop.dfs.DataNode: Received block blk_-4102605170938551016
from /33.33.33.33

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message