hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject OK to remove NN's edits file?
Date Mon, 07 Jul 2008 15:02:41 GMT

I have Hadoop 0.16.2 running in a cluster whose Namenode seems to have a corrupt "edits" file.
 This causes an EOFException during NN init, which causes NN to exit immediately (exception

What is the recommended thing to do in such a case?

I don't mind losing any of the data that is referenced in "edits" file.
Should I just remove the edits file, start NN, and assume the NN will create a new, empty
"edits" file and all will be well?

This is what I see when NN tries to start:

2008-07-07 10:58:43,255 ERROR dfs.NameNode - java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:180)
        at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)
        at org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)
        at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:433)
        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:756)
        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:639)
        at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:222)
        at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:79)
        at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:254)
        at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:235)
        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:131)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:176)
        at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:162)
        at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
        at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)

Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch

View raw message