hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1625) "could not move files" exception in DataXceiver
Date Wed, 18 Jul 2007 02:33:04 GMT
"could not move files" exception in DataXceiver
-----------------------------------------------

                 Key: HADOOP-1625
                 URL: https://issues.apache.org/jira/browse/HADOOP-1625
             Project: Hadoop
          Issue Type: Bug
    Affects Versions: 0.14.0
            Reporter: Konstantin Shvachko
             Fix For: 0.14.0


I am running TestDFSIO with the new crcs.
The test fails with the following exception repeated several times

07/07/17 19:15:50 WARN fs.DFSClient: Error while writing.
java.io.EOFException
    at java.io.DataInputStream.readByte(DataInputStream.java:243)
    at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1663)
    at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1735)
    at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:49)
    at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:64)
    at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:773)
    at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:129)
    at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:353)

The data-node log also contains an exception.

07/07/17 19:15:50 ERROR dfs.DataNode: DataXCeiver
java.io.IOException: could not move files for blk_-2838788366095905360 from tmp to C:\ndfs\data\current\blk_-2838788366095905360
    at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:93)
    at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:82)
    at org.apache.hadoop.dfs.FSDataset$FSVolume.addBlock(FSDataset.java:327)
    at org.apache.hadoop.dfs.FSDataset.finalizeBlock(FSDataset.java:593)
    at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:962)
    at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:734)
    at java.lang.Thread.run(Thread.java:595)

In debugger I can see that the meta-data file rename fails.
The data-node runs on windows (if it is relevant).
I mark it is as a blocker until the reverse is proven.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message