hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Murali Krishna" <mura...@yahoo-inc.com>
Subject RE: distcp skipping the file
Date Wed, 23 Jul 2008 04:46:35 GMT
Hi,
	I am using 0.15.3 and the destination is empty. One more
behavior that I am seeing is that if I pass '-update' option, it is
writing the content of file '2' in folder 1. (Makes the folder '1' as
file in the destination). So, look like it is treating the destination
for file distcpsrc/1/2 as distcpdest/1.

Thanks,
Murali

> -----Original Message-----
> From: Chris Douglas [mailto:chrisdo@yahoo-inc.com]
> Sent: Wednesday, July 23, 2008 1:13 AM
> To: core-user@hadoop.apache.org
> Subject: Re: distcp skipping the file
> 
> There were many fixes and improvements to distcp in 0.16, but most of
> the critical fixes made it into 0.15.2 and 0.15.3. Is the destination
> empty? Anything already existing at the destination is skipped. -C
> 
> On Jul 22, 2008, at 4:39 AM, Murali Krishna wrote:
> 
> > Hi,
> >
> > My source folder has a single folder and a single file inside that.
> >
> > /user/<user>/distcpsrc/1/2 <r 3>   4       2008-07-22 04:22
> >
> > In the destination, it is creating the folder '1' but not the file
> > '2'.
> >
> > The counters show 1 file has been skipped.
> >
> > 08/07/22 04:22:36 INFO mapred.JobClient:     Files skipped=1
> >
> >
> >
> > If I create one more file in any directory under the distscpsrc
> > folder,
> > it copies both the files properly. Is this a bug?
> >
> > [I am using 15.3]
> >
> >
> >
> > Thanks,
> >
> > Murali
> >


Mime
View raw message