hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kan Zhang <...@yahoo-inc.com>
Subject Re: HFTP based distcp failing.
Date Tue, 04 Jan 2011 22:50:54 GMT
Ravi, HFTP  only supports READ operation for now.


On 1/4/11 2:10 PM, "Ravi Phulari" <iphulari@gmail.com> wrote:

Hello Hadoopers,
  I need to distcp data across two clusters. For security reasons I can not use hdfs based
distcp.
HFTP based distcp is failing  with following Ioexception.

Stack trace.

Copy failed: java.io.IOException: Not supported
    at org.apache.hadoop.hdfs.HftpFileSystem.delete(HftpFileSystem.java:360)
    at org.apache.hadoop.tools.DistCp.fullyDelete(DistCp.java:939)
    at org.apache.hadoop.tools.DistCp.copy(DistCp.java:655)
    at org.apache.hadoop.tools.DistCp.run(DistCp.java:857)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at org.apache.hadoop.tools.DistCp.main(DistCp.java:884)

I am using following command for distcp.

Hadoop distcp  hftp://nn1.hadoop1:50070/data hftp://nn2.hadoop2:50070/user/hadoop/
Hadoop distcp  /data/logs    hftp://nn2.hadoop2:50070/user/hadoop/

Any idea why this distcp could be failing.
I don't see any logs in JT and NN.

Any help will be greatly appreciated.

-
Thanks,
Ravi


Mime
View raw message