Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of taiping.du@gmail.com
 designates 209.85.198.224 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=Q56Ui03FG5+NW6fB9F9JeO5vbbF83e+oP+E2mK8c8x3v+dZff6SzafSmsa8/IHPLwQ
         y6O7axIB/7EyTmR09V9IyqLSrAW35Yy9lJaDRHryMQIzz+fwPuv2CHB+XBDVhOzxJIpR
         DptGEjBV7qb0xjii24NM6wXbGe15TDPVdMYsY=
MIME-Version: 1.0
In-Reply-To: <546170.81195.qm@web56206.mail.re3.yahoo.com>
References: <710ef8220908051236jfd39ecesdf08a5a27cc9f506@mail.gmail.com>
	 <579522.63213.qm@web56201.mail.re3.yahoo.com>
	 <710ef8220908051354t407aa405oeb22a6c13f411f5a@mail.gmail.com>
	 <546170.81195.qm@web56206.mail.re3.yahoo.com>
Date: Wed, 5 Aug 2009 14:25:00 -0700
Message-ID: <710ef8220908051425ob12d02meb3b0928351f285f@mail.gmail.com>
Subject: Re: distcp between 0.17 and 0.18.3 issues
From: charles du <taiping.du@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=001636e0a701bd5b2a04706ba290

--001636e0a701bd5b2a04706ba290
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

Thanks a lot. It solved my problem.

Chuang

On Wed, Aug 5, 2009 at 2:04 PM, Tsz Wo (Nicholas), Sze <
s29752-hadoopuser@yahoo.com> wrote:

> >    hadoop distcp -i hftp://nn1:50070/src hftp://nn2:50070/dest
> The problem in the command above is hftp://nn2:50070/dest while hftp (i.e.
> HftpFileSystem) is a read-only file system.  You may change it to
> hdfs://nn2:xxxx/dest, where xxxx is a different port.  You may find the port
> number from the NN's web page.
>
>
> Nicholas
>
>
>
> ----- Original Message ----
> > From: charles du <taiping.du@gmail.com>
> > To: common-user@hadoop.apache.org
> > Sent: Wednesday, August 5, 2009 1:54:55 PM
> > Subject: Re: distcp between 0.17 and 0.18.3 issues
> >
> > Hi Nicholas:
> >
> > The command I used is
> >
> >    hadoop distcp -i hftp://nn1:50070/src hftp://nn2:50070/dest
> >
> > I ran "hadoop ls" on both src and destination, and it lists files just
> fine.
> > nn1 is 0.17.0, and nn2 is 0.18.3
> >
> > Thanks.
> >
> > tp
> >
> > On Wed, Aug 5, 2009 at 1:49 PM, Tsz Wo (Nicholas), Sze <
> > s29752-hadoopuser@yahoo.com> wrote:
> >
> > > Hi tp,
> > >
> > > distcp definitely supports copying file from a 0.17 cluster to a 0.18
> > > cluster.  The error message is saying that the delete operation is not
> > > supported in HftpFileSystem.  Would you mind to show me the actual
> command
> > > used?
> > >
> > > Nicholas Sze
> > >
> > >
> > >
> > >
> > > ----- Original Message ----
> > > > From: charles du
> > > > To: core-user@hadoop.apache.org
> > > > Sent: Wednesday, August 5, 2009 12:36:49 PM
> > > > Subject: distcp between 0.17 and 0.18.3 issues
> > > >
> > > > Hi:
> > > >
> > > > I tried to use "distcp" to copy files from one cluster running hadoop
> > > 0.17.0
> > > > to another cluster running hadoop 0.18.3, and got the following
> errors.
> > > >
> > > > With failures, global counters are inaccurate; consider running with
> -i
> > > > Copy failed: java.io.IOException: Not supported
> > > >         at
> > > > org.apache.hadoop.dfs.HftpFileSystem.delete(HftpFileSystem.java:263)
> > > >         at
> org.apache.hadoop.fs.FileUtil.fullyDelete(FileUtil.java:119)
> > > >         at
> org.apache.hadoop.tools.DistCp.fullyDelete(DistCp.java:843)
> > > >         at org.apache.hadoop.tools.DistCp.copy(DistCp.java:623)
> > > >         at org.apache.hadoop.tools.DistCp.run(DistCp.java:768)
> > > >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > > >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> > > >         at org.apache.hadoop.tools.DistCp.main(DistCp.java:788)
> > > >
> > > >
> > > > I ran the distcp from the 0.18.3 cluster. does the error message mean
> > > that
> > > > distcp does not support 0.17.0 as the copy source?
> > > >
> > > > Regards
> > > >
> > > > --
> > > > tp
> > >
> > >
> >
> >
> > --
> > tp
>
>


-- 
tp

--001636e0a701bd5b2a04706ba290--