hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mike anderson <saidthero...@gmail.com>
Subject can't start namenode
Date Thu, 04 Mar 2010 16:57:03 GMT
Our hadoop cluster went down last night when the namenode ran out of hard
drive space. Trying to restart fails with this exception (see below).

Since I don't really care that much about losing a days worth of data or so
I'm fine with blowing away the edits file if that's what it takes (we don't
have a secondary namenode to restore from). I tried removing the edits file
from the namenode directory, but then it complained about not finding an
edits file. I touched a blank edits file and I got the exact same exception.

Any thoughts? I googled around a bit, but to no avail.

-mike


2010-03-04 10:50:44,768 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=54310
2010-03-04 10:50:44,772 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at:
carr.projectlounge.com/10.0.16.91:54310
2010-03-04 10:50:44,773 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2010-03-04 10:50:44,774 INFO
org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics: Initializing
NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2010-03-04 10:50:44,816 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=pubget,pubget
2010-03-04 10:50:44,817 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup
2010-03-04 10:50:44,817 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isPermissionEnabled=true
2010-03-04 10:50:44,823 INFO
org.apache.hadoop.hdfs.server.namenode.metrics.FSNamesystemMetrics:
Initializing FSNamesystemMetrics using context
object:org.apache.hadoop.metrics.spi.NullContext
2010-03-04 10:50:44,825 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
FSNamesystemStatusMBean
2010-03-04 10:50:44,849 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files = 2687
2010-03-04 10:50:45,092 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files under construction = 7
2010-03-04 10:50:45,095 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 347821 loaded in 0 seconds.
2010-03-04 10:50:45,104 INFO org.apache.hadoop.hdfs.server.common.Storage:
Edits file /mnt/hadoop/name/current/edits of size 4653 edits # 39 loaded in
0 seconds.
2010-03-04 10:50:45,114 ERROR
org.apache.hadoop.hdfs.server.namenode.NameNode:
java.lang.NumberFormatException: For input string: ""
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Long.parseLong(Long.java:424)
at java.lang.Long.parseLong(Long.java:461)
at
org.apache.hadoop.hdfs.server.namenode.FSEditLog.readLong(FSEditLog.java:1273)
at
org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:670)
at
org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:997)
at
org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:812)
at
org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:364)
at
org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:87)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:311)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:292)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:201)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:279)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:956)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:965)

2010-03-04 10:50:45,115 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at carr.projectlounge.com/10.0.16.91
************************************************************/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message