Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9D93070A4 for ; Fri, 30 Sep 2011 20:31:13 +0000 (UTC) Received: (qmail 22272 invoked by uid 500); 30 Sep 2011 20:31:13 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 22213 invoked by uid 500); 30 Sep 2011 20:31:13 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 22090 invoked by uid 99); 30 Sep 2011 20:31:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Sep 2011 20:31:12 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Sep 2011 20:31:09 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 93A562A25E1 for ; Fri, 30 Sep 2011 20:30:47 +0000 (UTC) Date: Fri, 30 Sep 2011 20:30:47 +0000 (UTC) From: "Rajit Saha (Created) (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <91348117.13091.1317414647606.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Created] (HDFS-2392) Dist with hftp is failing again MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Dist with hftp is failing again ------------------------------- Key: HDFS-2392 URL: https://issues.apache.org/jira/browse/HDFS-2392 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.205.0 Reporter: Rajit Saha Priority: Critical $ hadoop distcp hftp://:50070/user/hadoopqa/input1/part-00000 /user/hadoopqa/out3 11/09/30 18:57:59 INFO tools.DistCp: srcPaths=[hftp://:50070/user/hadoopqa/input1/part-00000] 11/09/30 18:57:59 INFO tools.DistCp: destPath=/user/hadoopqa/out3 11/09/30 18:58:00 INFO security.TokenCache: Got dt for hftp://:50070/user/hadoopqa/input1/part-00000;uri=:50470;t.service=:50470 11/09/30 18:58:00 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 24 for hadoopqa on :8020 11/09/30 18:58:00 INFO security.TokenCache: Got dt for /user/hadoopqa/out3;uri=:8020;t.service=:8020 11/09/30 18:58:00 INFO tools.DistCp: /user/hadoopqa/out3 does not exist. 11/09/30 18:58:00 INFO tools.DistCp: sourcePathsCount=1 11/09/30 18:58:00 INFO tools.DistCp: filesToCopyCount=1 11/09/30 18:58:00 INFO tools.DistCp: bytesToCopyCount=1.0g 11/09/30 18:58:01 INFO mapred.JobClient: Running job: job_201109300819_0007 11/09/30 18:58:02 INFO mapred.JobClient: map 0% reduce 0% 11/09/30 18:58:25 INFO mapred.JobClient: Task Id : attempt_201109300819_0007_m_000000_0, Status : FAILED java.io.IOException: Copied: 0 Skipped: 0 Failed: 1 at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:249) 11/09/30 18:58:41 INFO mapred.JobClient: Task Id : attempt_201109300819_0007_m_000000_1, Status : FAILED java.io.IOException: Copied: 0 Skipped: 0 Failed: 1 at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:249) 11/09/30 18:58:56 INFO mapred.JobClient: Task Id : attempt_201109300819_0007_m_000000_2, Status : FAILED java.io.IOException: Copied: 0 Skipped: 0 Failed: 1 at org.apache.hadoop.tools.DistCp$CopyFilesMapper.close(DistCp.java:582) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:249) 11/09/30 18:59:14 INFO mapred.JobClient: Job complete: job_201109300819_0007 11/09/30 18:59:14 INFO mapred.JobClient: Counters: 6 11/09/30 18:59:14 INFO mapred.JobClient: Job Counters 11/09/30 18:59:14 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=62380 11/09/30 18:59:14 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0 11/09/30 18:59:14 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0 11/09/30 18:59:14 INFO mapred.JobClient: Launched map tasks=4 11/09/30 18:59:14 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0 11/09/30 18:59:14 INFO mapred.JobClient: Failed map tasks=1 11/09/30 18:59:14 INFO mapred.JobClient: Job Failed: # of failed Map Tasks exceeded allowed limit. FailedCount: 1. LastFailedTask: task_201109300819_0007_m_000000 With failures, global counters are inaccurate; consider running with -i Copy failed: java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1257) at org.apache.hadoop.tools.DistCp.copy(DistCp.java:667) at org.apache.hadoop.tools.DistCp.run(DistCp.java:881) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.tools.DistCp.main(DistCp.java:908) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira