hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wendy Chien (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-324) "IOException: No space left on device" is handled incorrectly
Date Tue, 08 Aug 2006 22:54:15 GMT
     [ http://issues.apache.org/jira/browse/HADOOP-324?page=all ]

Wendy Chien updated HADOOP-324:

    Attachment: hadoop-324.patch

This patch fixes the problem by checking the message of the IOException to see if it is "No
space left on device".   If so, then it throws a new DiskOutOfSpaceException and does not
shutdown.  If not, then it does what it originally did, shutdown.  

If there are objections to this way, please let me know.

> "IOException: No space left on device" is handled incorrectly
> -------------------------------------------------------------
>                 Key: HADOOP-324
>                 URL: http://issues.apache.org/jira/browse/HADOOP-324
>             Project: Hadoop
>          Issue Type: Bug
>    Affects Versions: 0.3.2
>            Reporter: Konstantin Shvachko
>         Assigned To: Wendy Chien
>         Attachments: hadoop-324.patch
> When a data node disk is almost full the name node still assigns blocks to the data node.
> By the time the data node actually tries to write that data to disk the disk may become
> Current implementation forces the data node to shutdown after that.
> The expected behavior is to report the block write failure and continue.
> The Exception looks as follows:
> java.io.IOException: No space left on device
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
> at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
> at java.io.DataOutputStream.write(DataOutputStream.java:90)
> at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:623)
> at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:410)
> at java.lang.Thread.run(Thread.java:595)
> 2006-06-26 08:26:04,751 INFO org.apache.hadoop.dfs.DataNode: Finishing DataNode in: /tmp/hadoop/dfs/data/data

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message