hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Karam Singh (JIRA)" <j...@apache.org>
Subject [jira] Resolved: (HDFS-38) DFSClient getting stuck intermittently giving "DFSClient: Could not complete file filename retrying..." message
Date Tue, 09 Feb 2010 12:38:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Karam Singh resolved HDFS-38.
-----------------------------

      Resolution: Not A Problem
    Release Note: Now I do not see this problem so marking this issue Resloved Not a problem

> DFSClient getting stuck intermittently giving "DFSClient: Could not complete file   filename
retrying..." message
> -----------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-38
>                 URL: https://issues.apache.org/jira/browse/HDFS-38
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Karam Singh
>
> While some streaming job with hadoop 0.18 and hadoop trunk, hadoop commands getting stuck
intermittently and keeps on printing message "DFSClient: <filename>Could not complete
file   retrying..."  in indefinite loop . 
> I have not faced this problem in hadoop 0.17,2.
> On one occasion after copying to hdfs second command "hadoop fs - put file.txt input/in.txt"
got stuck in hadoop 0.18 and hadoop trunk version
> Following is the message -:
> [
> 08/07/24 05:03:58 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt
 retrying...
> 08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt
  retrying...
> 08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt
 retrying...
> ]
> On second occasion command -: "hadoop jar hadoop-0.19.0-dev-examples.jar randomtextwriter
 rwout" got stuck with following -:
> [
> 08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/
job_200807240828_0028/job.xml retrying...
> 08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/
job_200807240828_0028/job.xml retrying...
> 08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/
job_200807240828_0028/job.xml retrying...
> 08/07/24 08:39:07 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/
job_200807240828_0028/job.xml retrying...
> ]
> This is intermittent and there is no specific pattern.  I do not have namenode logs as
I was hod for cluster allocation/deallocation with saving logs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message