Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id ED1BE109B6 for ; Mon, 30 Sep 2013 07:35:53 +0000 (UTC) Received: (qmail 54617 invoked by uid 500); 30 Sep 2013 07:34:33 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 53834 invoked by uid 500); 30 Sep 2013 07:34:26 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 53716 invoked by uid 99); 30 Sep 2013 07:34:21 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 30 Sep 2013 07:34:21 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of ravishetye@gmail.com designates 209.85.128.52 as permitted sender) Received: from [209.85.128.52] (HELO mail-qe0-f52.google.com) (209.85.128.52) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 30 Sep 2013 07:34:16 +0000 Received: by mail-qe0-f52.google.com with SMTP id i11so3434099qej.25 for ; Mon, 30 Sep 2013 00:33:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=ZHIAPAseFwrc5AKLLbC/NCQAREUj38vzyjbUtTm+Q3I=; b=RtExFoTdOqQ2x6jhzytPxW+R+2zLyOMrE/Eyh0qH6kl63kF13Ez5DtMh0eyri1qVqE TVS0YWnGOilcjbKLRFPGBvmpJM4+yIyE50SJdP6ZI3mQsAE92RIpheqCdHaqnXVFaEhX ztw5YkQaWZsWpuvFQADN0qslO0Fk3/W7ExG0MSIRBzSzTRDJVuY7oWv4t/HhutW+G7ly dAvjRJUHEKoIQT6ZwiHYIAMiCfZMFqr74fhLhxFnQYAu/oyyeuyEFkUgKl51PIvCXKj8 LA/HD3/kSwiNxnq+VbS36WjzDULEOF7GmrkmnnKIeIUwicaJoBA2QwsbxHvYeu9544ib kOtQ== MIME-Version: 1.0 X-Received: by 10.224.13.207 with SMTP id d15mr153992qaa.110.1380526435990; Mon, 30 Sep 2013 00:33:55 -0700 (PDT) Received: by 10.49.51.42 with HTTP; Mon, 30 Sep 2013 00:33:55 -0700 (PDT) Date: Mon, 30 Sep 2013 13:03:55 +0530 Message-ID: Subject: unable to restart namenode on hadoop 1.0.4 From: Ravi Shetye To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7bdc7f3ed2041b04e794dbfe X-Virus-Checked: Checked by ClamAV on apache.org --047d7bdc7f3ed2041b04e794dbfe Content-Type: text/plain; charset=ISO-8859-1 Can some one please help me about how I go ahead debugging the issue.The NN log has the following error stack 2013-09-30 07:28:42,768 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started 2013-09-30 07:28:42,967 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered. 2013-09-30 07:28:42,972 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2013-09-30 07:28:42,978 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm registered. 2013-09-30 07:28:42,980 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source NameNode registered. 2013-09-30 07:28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 64-bit 2013-09-30 07:28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 27.3075 MB 2013-09-30 07:28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^22 = 4194304 entries 2013-09-30 07:28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: recommended=4194304, actual=4194304 2013-09-30 07:28:43,084 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=ubuntu 2013-09-30 07:28:43,084 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup 2013-09-30 07:28:43,084 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=true 2013-09-30 07:28:43,119 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.block.invalidate.limit=100 2013-09-30 07:28:43,119 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) 2013-09-30 07:28:43,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemStateMBean and NameNodeMXBean 2013-09-30 07:28:43,207 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times 2013-09-30 07:28:43,221 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files = 528665 2013-09-30 07:28:49,109 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files under construction = 7 2013-09-30 07:28:49,111 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 79872266 loaded in 5 seconds. 2013-09-30 07:28:49,113 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.lang.NullPointerException at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1099) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1111) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.addNode(FSDirectory.java:1014) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.unprotectedAddFile(FSDirectory.java:208) at org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:631) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1021) at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:839) at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:377) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:362) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276) at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:496) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288) 2013-09-30 07:28:49,114 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG: -- RAVI SHETYE --047d7bdc7f3ed2041b04e794dbfe Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Can some one please help me about how I go ahead debugging= the issue.The NN log has the following error stack

2013-09-30 07:28:42,768 INFO org.apache.hadoop.metrics2.impl.MetricsSystem= Impl: NameNode metrics system started
2013-09-30 07:28:42,967 INFO org.apache.hadoop.metrics2.impl.MetricsSo= urceAdapter: MBean for source ugi registered.
2013-09-30 07:28:42= ,972 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ug= i already exists!
2013-09-30 07:28:42,978 INFO org.apache.hadoop.metrics2.impl.MetricsSo= urceAdapter: MBean for source jvm registered.
2013-09-30 07:28:42= ,980 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for s= ource NameNode registered.
2013-09-30 07:28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: VM type= =A0 =A0 =A0 =3D 64-bit
2013-09-30 07:28:43,012 INFO org.apache.h= adoop.hdfs.util.GSet: 2% max memory =3D 27.3075 MB
2013-09-30 07:= 28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: capacity =A0 =A0 =A0=3D 2^= 22 =3D 4194304 entries
2013-09-30 07:28:43,012 INFO org.apache.hadoop.hdfs.util.GSet: recomme= nded=3D4194304, actual=3D4194304
2013-09-30 07:28:43,084 INFO org= .apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=3Dubuntu
2013-09-30 07:28:43,084 INFO org.apache.hadoop.hdfs.server.namenode.FSNames= ystem: supergroup=3Dsupergroup
2013-09-30 07:28:43,084 INFO org.a= pache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=3Dtrue<= /div>
2013-09-30 07:28:43,119 INFO org.apache.hadoop.hdfs.server.namenode.FS= Namesystem: dfs.block.invalidate.limit=3D100
2013-09-30 07:28:43,= 119 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isAccessToken= Enabled=3Dfalse accessKeyUpdateInterval=3D0 min(s), accessTokenLifetime=3D0= min(s)
2013-09-30 07:28:43,183 INFO org.apache.hadoop.hdfs.server.namenode.FS= Namesystem: Registered FSNamesystemStateMBean and NameNodeMXBean
= 2013-09-30 07:28:43,207 INFO org.apache.hadoop.hdfs.server.namenode.NameNod= e: Caching file names occuring more than 10 times
2013-09-30 07:28:43,221 INFO org.apache.hadoop.hdfs.server.common.Stor= age: Number of files =3D 528665
2013-09-30 07:28:49,109 INFO org.= apache.hadoop.hdfs.server.common.Storage: Number of files under constructio= n =3D 7
2013-09-30 07:28:49,111 INFO org.apache.hadoop.hdfs.server.common.Stor= age: Image file of size 79872266 loaded in 5 seconds.
2013-09-30 = 07:28:49,113 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.la= ng.NullPointerException
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSDirectory.= addChild(FSDirectory.java:1099)
=A0 =A0 =A0 =A0 at org.apache.had= oop.hdfs.server.namenode.FSDirectory.addChild(FSDirectory.java:1111)
<= div>=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSDirectory.a= ddNode(FSDirectory.java:1014)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSDirectory.= unprotectedAddFile(FSDirectory.java:208)
=A0 =A0 =A0 =A0 at org.a= pache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:631)=
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSImag= e.loadFSEdits(FSImage.java:1021)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSImage.load= FSImage(FSImage.java:839)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hd= fs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:377)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loa= dFSImage(FSDirectory.java:100)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem= .initialize(FSNamesystem.java:388)
=A0 =A0 =A0 =A0 at org.apache.= hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362= )
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.initiali= ze(NameNode.java:276)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.s= erver.namenode.NameNode.<init>(NameNode.java:496)
=A0 =A0 = =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(N= ameNode.java:1279)
=A0 =A0 =A0 =A0 at org.apache.hadoop.hdfs.server.namenode.NameNode.mai= n(NameNode.java:1288)

2013-09-30 07:28:49,114 INFO= org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
<= br>

--
RAVI SHETYE --047d7bdc7f3ed2041b04e794dbfe--