hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <qwertyman...@gmail.com>
Subject Re: Warning while trying copy the data into HDFS
Date Sat, 29 Jan 2011 17:04:29 GMT
Please submit user queries to the appropriate user mailing list and
not development ones.

Moving this question to the hdfs-user list at hdfs-user@hadoop.apache.org

On Sat, Jan 29, 2011 at 3:01 PM, James Ram <hadooprj@gmail.com> wrote:
> Hi,
>
>         I am new to this group. I tried to copy a 1GB file to the HDFS.
> While copying the data it showed the below error. Anyhow it copied the data
> successfully. I am curious to know why this warning came up saying that my
> datanodes are bad. All the datanodes are alive and had more than 2GB space.
>
> 11/01/29 13:29:16 WARN hdfs.DFSClient: DataStreamer Exception:
> java.io.IOException: An existing connection was forcibly closed by the
> remote host
>        at sun.nio.ch.SocketDispatcher.write0(Native Method)
>        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:33)
>        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:104)
>        at sun.nio.ch.IOUtil.write(IOUtil.java:75)
>        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:334)
>        at
> org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:55)
>        at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
>        at
> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:146)
>        at
> org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:107)
>        at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
>        at java.io.DataOutputStream.write(DataOutputStream.java:90)
>        at
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2314)
>
> 11/01/29 13:29:16 WARN hdfs.DFSClient: Error Recovery for block
> blk_-6118816796046500135_1043 bad datanode[0] 160.110.74.37:50010
> 11/01/29 13:29:16 WARN hdfs.DFSClient: Error Recovery for block
> blk_-6118816796046500135_1043 in pipeline 160.110.74.37:50010,
> 160.110.74.36:50010, 160.110.74.39:50010: bad datanode 160.110.74.37:50010
> 11/01/29 13:29:18 WARN hdfs.DFSClient: Error Recovery for block
> blk_-6118816796046500135_1043 failed  because recovery from primary datanode
> 160.110.74.36:50010 failed 1 times.  Pipeline was 160.110.74.37:50010,
> 160.110.74.36:50010, 160.110.74.39:50010. Will retry...
> 11/01/29 13:29:18 WARN hdfs.DFSClient: Error Recovery for block
> blk_-6118816796046500135_1043 bad datanode[0] 160.110.74.37:50010
> 11/01/29 13:29:18 WARN hdfs.DFSClient: Error Recovery for block
> blk_-6118816796046500135_1043 in pipeline 160.110.74.37:50010,
> 160.110.74.36:50010, 160.110.74.39:50010: bad datanode 160.110.74.37:50010
>
> With Regards
> RJ
>



-- 
Harsh J
www.harshj.com

Mime
View raw message