Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 66640 invoked from network); 9 Feb 2010 12:38:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 9 Feb 2010 12:38:49 -0000 Received: (qmail 31978 invoked by uid 500); 9 Feb 2010 12:38:49 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 31927 invoked by uid 500); 9 Feb 2010 12:38:49 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 31917 invoked by uid 99); 9 Feb 2010 12:38:48 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Feb 2010 12:38:48 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.140] (HELO brutus.apache.org) (140.211.11.140) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 09 Feb 2010 12:38:48 +0000 Received: from brutus.apache.org (localhost [127.0.0.1]) by brutus.apache.org (Postfix) with ESMTP id EF79C234C1EE for ; Tue, 9 Feb 2010 04:38:27 -0800 (PST) Message-ID: <1876472235.148791265719107979.JavaMail.jira@brutus.apache.org> Date: Tue, 9 Feb 2010 12:38:27 +0000 (UTC) From: "Karam Singh (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Resolved: (HDFS-38) DFSClient getting stuck intermittently giving "DFSClient: Could not complete file filename retrying..." message MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karam Singh resolved HDFS-38. ----------------------------- Resolution: Not A Problem Release Note: Now I do not see this problem so marking this issue Resloved Not a problem > DFSClient getting stuck intermittently giving "DFSClient: Could not complete file filename retrying..." message > ----------------------------------------------------------------------------------------------------------------- > > Key: HDFS-38 > URL: https://issues.apache.org/jira/browse/HDFS-38 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Karam Singh > > While some streaming job with hadoop 0.18 and hadoop trunk, hadoop commands getting stuck intermittently and keeps on printing message "DFSClient: Could not complete file retrying..." in indefinite loop . > I have not faced this problem in hadoop 0.17,2. > On one occasion after copying to hdfs second command "hadoop fs - put file.txt input/in.txt" got stuck in hadoop 0.18 and hadoop trunk version > Following is the message -: > [ > 08/07/24 05:03:58 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying... > 08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying... > 08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying... > ] > On second occasion command -: "hadoop jar hadoop-0.19.0-dev-examples.jar randomtextwriter rwout" got stuck with following -: > [ > 08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying... > 08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying... > 08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying... > 08/07/24 08:39:07 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying... > ] > This is intermittent and there is no specific pattern. I do not have namenode logs as I was hod for cluster allocation/deallocation with saving logs. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.