hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From charles du <taiping...@gmail.com>
Subject Re: distcp between 0.17 and 0.18.3 issues
Date Wed, 05 Aug 2009 21:25:00 GMT
Thanks a lot. It solved my problem.

Chuang

On Wed, Aug 5, 2009 at 2:04 PM, Tsz Wo (Nicholas), Sze <
s29752-hadoopuser@yahoo.com> wrote:

> >    hadoop distcp -i hftp://nn1:50070/src hftp://nn2:50070/dest
> The problem in the command above is hftp://nn2:50070/dest while hftp (i.e.
> HftpFileSystem) is a read-only file system.  You may change it to
> hdfs://nn2:xxxx/dest, where xxxx is a different port.  You may find the port
> number from the NN's web page.
>
>
> Nicholas
>
>
>
> ----- Original Message ----
> > From: charles du <taiping.du@gmail.com>
> > To: common-user@hadoop.apache.org
> > Sent: Wednesday, August 5, 2009 1:54:55 PM
> > Subject: Re: distcp between 0.17 and 0.18.3 issues
> >
> > Hi Nicholas:
> >
> > The command I used is
> >
> >    hadoop distcp -i hftp://nn1:50070/src hftp://nn2:50070/dest
> >
> > I ran "hadoop ls" on both src and destination, and it lists files just
> fine.
> > nn1 is 0.17.0, and nn2 is 0.18.3
> >
> > Thanks.
> >
> > tp
> >
> > On Wed, Aug 5, 2009 at 1:49 PM, Tsz Wo (Nicholas), Sze <
> > s29752-hadoopuser@yahoo.com> wrote:
> >
> > > Hi tp,
> > >
> > > distcp definitely supports copying file from a 0.17 cluster to a 0.18
> > > cluster.  The error message is saying that the delete operation is not
> > > supported in HftpFileSystem.  Would you mind to show me the actual
> command
> > > used?
> > >
> > > Nicholas Sze
> > >
> > >
> > >
> > >
> > > ----- Original Message ----
> > > > From: charles du
> > > > To: core-user@hadoop.apache.org
> > > > Sent: Wednesday, August 5, 2009 12:36:49 PM
> > > > Subject: distcp between 0.17 and 0.18.3 issues
> > > >
> > > > Hi:
> > > >
> > > > I tried to use "distcp" to copy files from one cluster running hadoop
> > > 0.17.0
> > > > to another cluster running hadoop 0.18.3, and got the following
> errors.
> > > >
> > > > With failures, global counters are inaccurate; consider running with
> -i
> > > > Copy failed: java.io.IOException: Not supported
> > > >         at
> > > > org.apache.hadoop.dfs.HftpFileSystem.delete(HftpFileSystem.java:263)
> > > >         at
> org.apache.hadoop.fs.FileUtil.fullyDelete(FileUtil.java:119)
> > > >         at
> org.apache.hadoop.tools.DistCp.fullyDelete(DistCp.java:843)
> > > >         at org.apache.hadoop.tools.DistCp.copy(DistCp.java:623)
> > > >         at org.apache.hadoop.tools.DistCp.run(DistCp.java:768)
> > > >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > > >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> > > >         at org.apache.hadoop.tools.DistCp.main(DistCp.java:788)
> > > >
> > > >
> > > > I ran the distcp from the 0.18.3 cluster. does the error message mean
> > > that
> > > > distcp does not support 0.17.0 as the copy source?
> > > >
> > > > Regards
> > > >
> > > > --
> > > > tp
> > >
> > >
> >
> >
> > --
> > tp
>
>


-- 
tp

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message