Return-Path: Delivered-To: apmail-hadoop-core-dev-archive@www.apache.org Received: (qmail 40585 invoked from network); 21 Oct 2008 21:33:42 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 21 Oct 2008 21:33:42 -0000 Received: (qmail 43281 invoked by uid 500); 21 Oct 2008 21:33:37 -0000 Delivered-To: apmail-hadoop-core-dev-archive@hadoop.apache.org Received: (qmail 43247 invoked by uid 500); 21 Oct 2008 21:33:37 -0000 Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-dev@hadoop.apache.org Delivered-To: mailing list core-dev@hadoop.apache.org Received: (qmail 43236 invoked by uid 99); 21 Oct 2008 21:33:37 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Oct 2008 14:33:37 -0700 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 21 Oct 2008 21:32:35 +0000 Received: from brutus (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id 455CA234C228 for ; Tue, 21 Oct 2008 14:32:44 -0700 (PDT) Message-ID: <1823991747.1224624764269.JavaMail.jira@brutus> Date: Tue, 21 Oct 2008 14:32:44 -0700 (PDT) From: "Robert Chansler (JIRA)" To: core-dev@hadoop.apache.org Subject: [jira] Updated: (HADOOP-3889) distcp: Better Error Message should be thrown when accessing source files/directory with no read permission In-Reply-To: <1952464582.1217619871926.JavaMail.jira@brutus> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HADOOP-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HADOOP-3889: ------------------------------------ Release Note: Changed DistCp error messages when there is a RemoteException. Changed the corresponding return value from -999 to -3. (was: Changed DistCp error messages when there is a RemoteException. Also changed the corresponding return value from -999 to -3.) Hadoop Flags: [Incompatible change, Reviewed] (was: [Reviewed, Incompatible change]) > distcp: Better Error Message should be thrown when accessing source files/directory with no read permission > ----------------------------------------------------------------------------------------------------------- > > Key: HADOOP-3889 > URL: https://issues.apache.org/jira/browse/HADOOP-3889 > Project: Hadoop Core > Issue Type: Bug > Components: tools/distcp > Affects Versions: 0.17.1 > Reporter: Peeyush Bishnoi > Assignee: Tsz Wo (Nicholas), SZE > Priority: Minor > Fix For: 0.19.0 > > Attachments: 3889_20080813.patch, 3889_20080813b.patch > > > Distcp: Better Error Message should be thrown when accessing/copying source files/directory with no read permission . So that it would help user to somehow avoid copying that subdirectory or get the owner to change the permissions. > $ hadoop dfs -lsr /user/scoopy/ > Found 1 items > /user/scoopy/string1 2054687 2008-08-01 10:41 rwx------ scoopy data > --> Trying to copy the file which tom don't have permission to read > $ logname > tom > $ hadoop distcp -i hftp://namenode1:8121/user/scoopy/string1 hdfs://namenode2:8121/user/tom/ > 08/07/31 17:36:00 INFO util.CopyFiles: srcPaths=[hftp://namenode1:8121/user/scoopy/string1] > 08/07/31 17:36:00 INFO util.CopyFiles: destPath=hdfs://namenode2:8121/user/tom/ > With failures, global counters are inaccurate; consider running with -i > Copy failed: java.io.IOException: invalid xml directory content > at org.apache.hadoop.dfs.HftpFileSystem$LsParser.fetchList(HftpFileSystem.java:184) > at org.apache.hadoop.dfs.HftpFileSystem$LsParser.listStatus(HftpFileSystem.java:199) > at org.apache.hadoop.dfs.HftpFileSystem$LsParser.listStatus(HftpFileSystem.java:207) > at org.apache.hadoop.dfs.HftpFileSystem.listStatus(HftpFileSystem.java:214) > at org.apache.hadoop.util.CopyFiles.setup(CopyFiles.java:933) > at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:603) > at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:743) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) > at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:763) > Caused by: org.xml.sax.SAXException: Unrecognized entry: RemoteException > at org.apache.hadoop.dfs.HftpFileSystem$LsParser.startElement(HftpFileSystem.java:151) > at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:501) > at > com.sun.org.apache.xerces.internal.parsers.AbstractXMLDocumentParser.emptyElement(AbstractXMLDocumentParser.java:179) > at > com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.scanStartElement(XMLNSDocumentScannerImpl.java:377) > at > com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2740) > at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:647) > at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:140) > at > com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:508) > at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:807) > at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737) > at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:107) > at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1205) > at org.apache.hadoop.dfs.HftpFileSystem$LsParser.fetchList(HftpFileSystem.java:182) > ... 9 more > ---- -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.