hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ac@hsk.hk" ...@hsk.hk>
Subject Re: IOException:Error Recovery for block
Date Sun, 09 Dec 2012 11:51:15 GMT
Hi,

Can you let us know which Hadoop version you are using?

Thanks
ac

On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:

> Hi All,
> 
> When grepping the error logs i could see the below for a job which process some 500GB
of data. What would be the cause and how to avoid it further?
> 
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed
 because recovery from primary datanode 12.104.0.154:50010 failed 6 times.  Pipeline was 12.104.0.154:50010.
Aborting...
> 	at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> 	at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> 	at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
> 
> Cheers!
> Manoj.
> 


Mime
View raw message