hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alfonso Olias Sanz" <alfonso.olias.s...@gmail.com>
Subject [core] datanode Exception error wiht dfs.replication to 1
Date Mon, 24 Mar 2008 12:41:19 GMT

I set up the property dfs.replication to 1
and I got this error while coping files to the DFS.

[aolias@gaiawl05 ~/software/Hadoop/hadoop-0.16.0]$ bin/hadoop dfs
-copyFromLocal /home2/mtlinden/simdata/GASS-RDS-3-G/tm IDT
08/03/24 11:46:32 WARN fs.DFSClient: DataStreamer Exception:
java.net.SocketException: Broken pipe
08/03/24 11:46:32 WARN fs.DFSClient: DFSOutputStream ResponseProcessor
exception  for block blk_-4394769012041379459java.net.SocketException:
Connection reset
        at java.net.SocketInputStream.read(SocketInputStream.java:168)
        at java.io.DataInputStream.readFully(DataInputStream.java:178)
        at java.io.DataInputStream.readLong(DataInputStream.java:399)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream$ResponseProcessor.run(DFSClient.java:1726)

I checked the web app and the node where I was performing the copy
command had no space left and the rest of the data nodes where empty.
 I also run the same test with the balancer, and I got the same
result. With no data balanced among all the data nodes.

The purpose is to spread some temporary files with no replication.
Just one instance of the file.


View raw message