hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ayon Sinha <ayonsi...@yahoo.com>
Subject distcp -i option help
Date Mon, 15 Aug 2011 20:15:12 GMT
Hi,
I'm trying to copy data from one cluster to the other. Without the -i option it fails at a
certain point so when I run with -i option it completes but I can be sure that the entire
contents are reliably copied.

The documentation for the -i option is not very good. Can someone explain if the task attempt
that failed would be retried or not?

Will distcp finish with the -i option even when some blocks of some files failed to get copied?
That would leave the files in an inconsistent state, right?
 
-Ayon
See My Photos on Flickr
Also check out my Blog for answers to commonly asked questions.

Mime
View raw message