hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Senthil Kumar <senthilec...@gmail.com>
Subject Block Replace Operation in Mover/Balancer
Date Thu, 06 Oct 2016 10:12:19 GMT
Hi All ,  Recently we have upgraded our Cluster to Hadoop 2.7.1 version.



When i try to run Mover , it throws  below exception :

2016-10-06 00:24:44,643 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: opCopyBlock
BP-1267816582-10.114.118.11-1392844883031:blk_12046985669_1111160995799
received exception java.net.SocketException: Original Exception :
java.io.IOException: Connection reset by peer
2016-10-06 00:31:49,846 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: opCopyBlock
BP-1267816582-10.114.118.11-1392844883031:blk_12046985669_1111160995799
received exception java.net.SocketException: Original Exception :
java.io.IOException: Connection reset by peer
2016-10-06 02:31:37,153 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: opCopyBlock
BP-1267816582-10.114.118.11-1392844883031:blk_12046985669_1111160995799
received exception java.net.SocketException: Original Exception :
java.io.IOException: Broken pipe
2016-10-06 02:43:10,751 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Copied
BP-1267816582-10.114.118.11-1392844883031:blk_12046985669_1111160995799 to /
10.115.70.28:35730
2016-10-06 02:54:18,866 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: opCopyBlock
BP-1267816582-10.114.118.11-1392844883031:blk_12046985669_1111160995799
received
exception java.net.SocketException: Original Exception :
java.io.IOException: Connection reset by peer



Not sure why Client closing the connection before operation completes ?.

Here is the piece of Code which actually Replace the Blocks in Mover ..
/** Send a reportedBlock replace request to the output stream */
    private void sendRequest(DataOutputStream out, ExtendedBlock eb,
        Token<BlockTokenIdentifier> accessToken) throws IOException {
      new Sender(out).replaceBlock(eb, target.storageType, accessToken,
          source.getDatanodeInfo().getDatanodeUuid(), proxySource.datanode);
    }


Did anyone face this problem while running mover or balancer ??

--Senthil

Mime
View raw message