hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manoj Babu <manoj...@gmail.com>
Subject IOException:Error Recovery for block
Date Sun, 09 Dec 2012 07:03:07 GMT
Hi All,

When grepping the error logs i could see the below for a job which process
some 500GB of data. What would be the cause and how to avoid it further?

java.io.IOException: Error Recovery for block
blk_4907953961673137346_1929435 failed  because recovery from primary
datanode failed 6 times.  Pipeline was Aborting...
	at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
	at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
	at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)


View raw message