hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Stack <st...@duboce.net>
Subject hdfs close of a file failing
Date Wed, 22 Aug 2007 22:18:24 GMT
Anyone have any pointers debugging why an odd HDFS close is failing?

Here is the exception I'm getting.

2007-08-22 21:45:21,459 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 1 on 9000, call 
complete(/bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,,8918388410463499185/repo/mapfiles/-1/data,

DFSClient_1857293290) from 208.76.44.139:52301: error: 
java.io.IOException: Unknown file: 
/bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,,8918388410463499185/repo/mapfiles/-1/data
java.io.IOException: Unknown file: 
/bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,,8918388410463499185/repo/mapfiles/-1/data
    at org.apache.hadoop.dfs.FSDirectory.addBlocks(FSDirectory.java:561)
    at 
org.apache.hadoop.dfs.FSNamesystem.completeFileInternal(FSNamesystem.java:1002)
    at 
org.apache.hadoop.dfs.FSNamesystem.completeFile(FSNamesystem.java:952)
    at org.apache.hadoop.dfs.NameNode.complete(NameNode.java:348)    at 
sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)    
at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566)
   ...

Its an open, write a few records and then a close.  Usually it works.

My hadoop is TRUNK, perhaps a couple of hours old (r567876).  Nothing in 
dmesg.  On this machine I only have 1024 file descriptors but I'd expect 
to see complaint about file handles if this were the issue.

Thanks,
St.Ack

Mime
View raw message