hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ANKUR GOEL <ankur.g...@corp.aol.com>
Subject Namenode Failure
Date Thu, 13 Nov 2008 12:34:15 GMT
Hi Folks,
             We have been running hadoop-0.17.2 release on a 50 machine 
cluster and we recently experience a namenode failure because of disk 
becoming full. The node is unable to start-up now and throws the 
following exception

2008-11-13 06:41:18,618 INFO org.apache.hadoop.ipc.Server: Stopping 
server on 9000
2008-11-13 06:41:18,619 ERROR org.apache.hadoop.dfs.NameNode: 
java.io.EOFException
        at java.io.DataInputStream.readFully(DataInputStream.java:180)
        at org.apache.hadoop.io.UTF8.readFields(UTF8.java:106)
        at 
org.apache.hadoop.io.ArrayWritable.readFields(ArrayWritable.java:90)
        at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:599)
        at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
        at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
        at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
        at 
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
        at 
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
        at 
org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
        at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
        at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
 
What is the best way to recover this failure with minimal data loss ?
I could not find instructions on wiki or anywhere else for release 
0.17.2 to do recovery using files from secondary namenode ?

Any help is greatly appreciated.

Thanks
-Ankur

Mime
View raw message