hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From charles du <taiping...@gmail.com>
Subject Re: distcp between 0.17 and 0.18.3 issues
Date Wed, 05 Aug 2009 20:54:55 GMT
Hi Nicholas:

The command I used is

   hadoop distcp -i hftp://nn1:50070/src hftp://nn2:50070/dest

I ran "hadoop ls" on both src and destination, and it lists files just fine.
nn1 is 0.17.0, and nn2 is 0.18.3

Thanks.

tp

On Wed, Aug 5, 2009 at 1:49 PM, Tsz Wo (Nicholas), Sze <
s29752-hadoopuser@yahoo.com> wrote:

> Hi tp,
>
> distcp definitely supports copying file from a 0.17 cluster to a 0.18
> cluster.  The error message is saying that the delete operation is not
> supported in HftpFileSystem.  Would you mind to show me the actual command
> used?
>
> Nicholas Sze
>
>
>
>
> ----- Original Message ----
> > From: charles du <taiping.du@gmail.com>
> > To: core-user@hadoop.apache.org
> > Sent: Wednesday, August 5, 2009 12:36:49 PM
> > Subject: distcp between 0.17 and 0.18.3 issues
> >
> > Hi:
> >
> > I tried to use "distcp" to copy files from one cluster running hadoop
> 0.17.0
> > to another cluster running hadoop 0.18.3, and got the following errors.
> >
> > With failures, global counters are inaccurate; consider running with -i
> > Copy failed: java.io.IOException: Not supported
> >         at
> > org.apache.hadoop.dfs.HftpFileSystem.delete(HftpFileSystem.java:263)
> >         at org.apache.hadoop.fs.FileUtil.fullyDelete(FileUtil.java:119)
> >         at org.apache.hadoop.tools.DistCp.fullyDelete(DistCp.java:843)
> >         at org.apache.hadoop.tools.DistCp.copy(DistCp.java:623)
> >         at org.apache.hadoop.tools.DistCp.run(DistCp.java:768)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >         at org.apache.hadoop.tools.DistCp.main(DistCp.java:788)
> >
> >
> > I ran the distcp from the 0.18.3 cluster. does the error message mean
> that
> > distcp does not support 0.17.0 as the copy source?
> >
> > Regards
> >
> > --
> > tp
>
>


-- 
tp

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message