Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 1015 invoked from network); 22 Jul 2008 19:44:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 22 Jul 2008 19:44:46 -0000 Received: (qmail 34013 invoked by uid 500); 22 Jul 2008 19:44:41 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 33965 invoked by uid 500); 22 Jul 2008 19:44:41 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 33953 invoked by uid 99); 22 Jul 2008 19:44:41 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Jul 2008 12:44:41 -0700 X-ASF-Spam-Status: No, hits=1.2 required=10.0 tests=SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [69.147.107.20] (HELO mrout1-b.corp.re1.yahoo.com) (69.147.107.20) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Jul 2008 19:43:45 +0000 Received: from [192.168.1.106] (snvvpn1-10-72-72-c209.corp.yahoo.com [10.72.72.209]) by mrout1-b.corp.re1.yahoo.com (8.13.8/8.13.8/y.out) with ESMTP id m6MJgpmu090359 for ; Tue, 22 Jul 2008 12:42:51 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=message-id:from:to:in-reply-to:content-type: content-transfer-encoding:mime-version:subject:date:references:x-mailer; b=K0gpErP/dZ5yeEkgInxPa9hp5FoLzFfyN5pvzTr0+zH2m5U0XSj7Lp6raJSPXx7O Message-Id: From: Chris Douglas To: core-user@hadoop.apache.org In-Reply-To: <6BEB21C567740F4A83F93D3BC8C9FE6D024F5AD2@SNV-EXVS03.ds.corp.yahoo.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v926) Subject: Re: distcp skipping the file Date: Tue, 22 Jul 2008 12:42:50 -0700 References: <6BEB21C567740F4A83F93D3BC8C9FE6D024F5AD2@SNV-EXVS03.ds.corp.yahoo.com> X-Mailer: Apple Mail (2.926) X-Virus-Checked: Checked by ClamAV on apache.org There were many fixes and improvements to distcp in 0.16, but most of the critical fixes made it into 0.15.2 and 0.15.3. Is the destination empty? Anything already existing at the destination is skipped. -C On Jul 22, 2008, at 4:39 AM, Murali Krishna wrote: > Hi, > > My source folder has a single folder and a single file inside that. > > /user//distcpsrc/1/2 4 2008-07-22 04:22 > > In the destination, it is creating the folder '1' but not the file > '2'. > > The counters show 1 file has been skipped. > > 08/07/22 04:22:36 INFO mapred.JobClient: Files skipped=1 > > > > If I create one more file in any directory under the distscpsrc > folder, > it copies both the files properly. Is this a bug? > > [I am using 15.3] > > > > Thanks, > > Murali >