hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ayon Sinha <ayonsi...@yahoo.com>
Subject distcp -i option help
Date Mon, 15 Aug 2011 20:15:12 GMT
I'm trying to copy data from one cluster to the other. Without the -i option it fails at a
certain point so when I run with -i option it completes but I can be sure that the entire
contents are reliably copied.

The documentation for the -i option is not very good. Can someone explain if the task attempt
that failed would be retried or not?

Will distcp finish with the -i option even when some blocks of some files failed to get copied?
That would leave the files in an inconsistent state, right?
See My Photos on Flickr
Also check out my Blog for answers to commonly asked questions.

View raw message