Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BF4059EB4 for ; Thu, 9 Aug 2012 12:54:23 +0000 (UTC) Received: (qmail 20844 invoked by uid 500); 9 Aug 2012 12:54:18 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 20712 invoked by uid 500); 9 Aug 2012 12:54:18 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 20705 invoked by uid 99); 9 Aug 2012 12:54:18 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2012 12:54:18 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sudyduan@gmail.com designates 209.85.213.176 as permitted sender) Received: from [209.85.213.176] (HELO mail-yx0-f176.google.com) (209.85.213.176) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Aug 2012 12:54:12 +0000 Received: by yenm12 with SMTP id m12so411719yen.35 for ; Thu, 09 Aug 2012 05:53:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=0P3tTgu5/BIhYXGUcuA5junMsB/POH2auEgBKbPnNzw=; b=sFyYjL3FsaFLjCffB8kpZVNxVqGOWvesmLwASB8mccHSCU6oU0r6YS7xZVw4wL36sr dVWWffdqsEZsHon7JMNgiLXUYcp0XWghDPnyrDK4RkaO9A4Bn5WqXJSsLG4D7Wuxc5Ry f7dcVO+9wzOittDqKa3jzzQMm9I5R01r3pGC3B8PY5qGllZ0HcDdM+crRetLUtIhuKtY jgHxz0IS02CLTitBpBPD/3cCkWRLdCk12rCPFnEIssguc4rr41WIvl0ZZhdBer1hJtrs 3XIf78EJESb+ZCMI1+c5t5jG4yVIdRZsE/HPeBeHjB9Ovbe5KHOtLH2fCw7C8R616xxV IZjQ== MIME-Version: 1.0 Received: by 10.43.43.194 with SMTP id ud2mr2574910icb.13.1344516830605; Thu, 09 Aug 2012 05:53:50 -0700 (PDT) Received: by 10.64.25.130 with HTTP; Thu, 9 Aug 2012 05:53:50 -0700 (PDT) In-Reply-To: References: Date: Thu, 9 Aug 2012 20:53:50 +0800 Message-ID: Subject: Re: namenode instantiation error From: Owen Duan To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec529a17515438e04c6d4b887 X-Virus-Checked: Checked by ClamAV on apache.org --bcaec529a17515438e04c6d4b887 Content-Type: text/plain; charset=ISO-8859-1 have you tried hadoop namenode -format? 2012/8/9 anand sharma > yea Tariq !1 its a fresh installation i m doing it for the first time, > hope someone will know the error code and the reason of error. > > > On Thu, Aug 9, 2012 at 5:35 PM, Mohammad Tariq wrote: > >> Hi Anand, >> >> Have you tried any other Hadoop distribution or version also??In >> that case first remove the older one and start fresh. >> >> Regards, >> Mohammad Tariq >> >> >> On Thu, Aug 9, 2012 at 5:29 PM, Mohammad Tariq >> wrote: >> > Hello Rahul, >> > >> > That's great. That's the best way to learn(I am doing the same :) >> > ). Since the installation part is over, I would suggest to get >> > yourself familiar with Hdfs and MapReduce first. Try to do basic >> > filesystem operations using the Hdfs API and run the wordcount >> > program, if you haven't done it yet. Then move ahead. >> > >> > Regards, >> > Mohammad Tariq >> > >> > >> > On Thu, Aug 9, 2012 at 5:20 PM, rahul p >> wrote: >> >> Hi Tariq, >> >> >> >> I am also new to Hadoop trying to learn my self can anyone help me on >> the >> >> same. >> >> i have installed CDH3. >> >> >> >> >> >> >> >> On Thu, Aug 9, 2012 at 6:21 PM, Mohammad Tariq >> wrote: >> >>> >> >>> Hello Anand, >> >>> >> >>> Is there any specific reason behind not using ssh?? >> >>> >> >>> Regards, >> >>> Mohammad Tariq >> >>> >> >>> >> >>> On Thu, Aug 9, 2012 at 3:46 PM, anand sharma >> >>> wrote: >> >>> > Hi, i am just learning the Hadoop and i am setting the development >> >>> > environment with CDH3 pseudo distributed mode without any ssh >> >>> > cofiguration >> >>> > in CentOS 6.2 . i can run the sample programs as usual but when i >> try >> >>> > and >> >>> > run namenode this is the error it logs... >> >>> > >> >>> > [hive@localhost ~]$ hadoop namenode >> >>> > 12/08/09 20:56:57 INFO namenode.NameNode: STARTUP_MSG: >> >>> > /************************************************************ >> >>> > STARTUP_MSG: Starting NameNode >> >>> > STARTUP_MSG: host = localhost.localdomain/127.0.0.1 >> >>> > STARTUP_MSG: args = [] >> >>> > STARTUP_MSG: version = 0.20.2-cdh3u4 >> >>> > STARTUP_MSG: build = >> >>> > file:///data/1/tmp/topdir/BUILD/hadoop-0.20.2-cdh3u4 >> >>> > -r 214dd731e3bdb687cb55988d3f47dd9e248c5690; compiled by 'root' on >> Mon >> >>> > May >> >>> > 7 14:01:59 PDT 2012 >> >>> > ************************************************************/ >> >>> > 12/08/09 20:56:57 INFO jvm.JvmMetrics: Initializing JVM Metrics with >> >>> > processName=NameNode, sessionId=null >> >>> > 12/08/09 20:56:57 INFO metrics.NameNodeMetrics: Initializing >> >>> > NameNodeMeterics using context >> >>> > object:org.apache.hadoop.metrics.spi.NoEmitMetricsContext >> >>> > 12/08/09 20:56:57 INFO util.GSet: VM type = 64-bit >> >>> > 12/08/09 20:56:57 INFO util.GSet: 2% max memory = 17.77875 MB >> >>> > 12/08/09 20:56:57 INFO util.GSet: capacity = 2^21 = 2097152 >> entries >> >>> > 12/08/09 20:56:57 INFO util.GSet: recommended=2097152, >> actual=2097152 >> >>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: fsOwner=hive >> (auth:SIMPLE) >> >>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: supergroup=supergroup >> >>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: >> isPermissionEnabled=false >> >>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: >> >>> > dfs.block.invalidate.limit=1000 >> >>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: >> isAccessTokenEnabled=false >> >>> > accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) >> >>> > 12/08/09 20:56:57 INFO metrics.FSNamesystemMetrics: Initializing >> >>> > FSNamesystemMetrics using context >> >>> > object:org.apache.hadoop.metrics.spi.NoEmitMetricsContext >> >>> > 12/08/09 20:56:57 ERROR namenode.FSNamesystem: FSNamesystem >> >>> > initialization >> >>> > failed. >> >>> > java.io.FileNotFoundException: >> >>> > /var/lib/hadoop-0.20/cache/hadoop/dfs/name/in_use.lock (Permission >> >>> > denied) >> >>> > at java.io.RandomAccessFile.open(Native Method) >> >>> > at java.io.RandomAccessFile.(RandomAccessFile.java:216) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.tryLock(Storage.java:614) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:591) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:449) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:304) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:110) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:372) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:335) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:271) >> >>> > at >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:467) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1330) >> >>> > at >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1339) >> >>> > 12/08/09 20:56:57 ERROR namenode.NameNode: >> >>> > java.io.FileNotFoundException: >> >>> > /var/lib/hadoop-0.20/cache/hadoop/dfs/name/in_use.lock (Permission >> >>> > denied) >> >>> > at java.io.RandomAccessFile.open(Native Method) >> >>> > at java.io.RandomAccessFile.(RandomAccessFile.java:216) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.tryLock(Storage.java:614) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:591) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:449) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:304) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:110) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:372) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:335) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:271) >> >>> > at >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:467) >> >>> > at >> >>> > >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1330) >> >>> > at >> >>> > >> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1339) >> >>> > >> >>> > 12/08/09 20:56:57 INFO namenode.NameNode: SHUTDOWN_MSG: >> >>> > /************************************************************ >> >>> > SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/ >> 127.0.0.1 >> >>> > ************************************************************/ >> >>> > >> >>> > >> >> >> >> >> > > --bcaec529a17515438e04c6d4b887 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable have you tried hadoop namenode -format?

2= 012/8/9 anand sharma <anand2sharma@gmail.com>
yea=A0 Tariq=A0!1 its a fresh=A0installation=A0i m doing it for the first time, ho= pe someone will know the error code and the reason of error.


On Thu, Aug 9, = 2012 at 5:35 PM, Mohammad Tariq <dontariq@gmail.com> wrote:=
Hi Anand,

=A0 =A0 =A0 Have you tried any other Hadoop distribution or version also??I= n
that case first remove the older one and start fresh.

Regards,
=A0 =A0 Mohammad Tariq


On Thu, Aug 9, 2012 at 5:29 PM, Mohammad Tariq <dontariq@gmail.com> wrote:
> Hello Rahul,
>
> =A0 =A0That's great. That's the best way to learn(I am doing t= he same :)
> ). Since the installation part is over, I would suggest to get
> yourself familiar with Hdfs and MapReduce first. Try to do basic
> filesystem operations using the Hdfs API and run the wordcount
> program, if you haven't done it yet. Then move ahead.
>
> Regards,
> =A0 =A0 Mohammad Tariq
>
>
> On Thu, Aug 9, 2012 at 5:20 PM, rahul p <rahulpoolanchalil@gmail.com> = wrote:
>> Hi Tariq,
>>
>> I am also new to Hadoop trying to learn my self can anyone help me= on the
>> same.
>> i have installed CDH3.
>>
>>
>>
>> On Thu, Aug 9, 2012 at 6:21 PM, Mohammad Tariq <dontariq@gmail.com> wrote:<= br> >>>
>>> Hello Anand,
>>>
>>> =A0 =A0 Is there any specific reason behind not using ssh?? >>>
>>> Regards,
>>> =A0 =A0 Mohammad Tariq
>>>
>>>
>>> On Thu, Aug 9, 2012 at 3:46 PM, anand sharma <anand2sharma@gmail.com&g= t;
>>> wrote:
>>> > Hi, i am just learning the Hadoop and i am setting the de= velopment
>>> > environment with CDH3 pseudo distributed mode without any= ssh
>>> > cofiguration
>>> > in CentOS 6.2 . i can run the sample programs as usual bu= t when i try
>>> > and
>>> > run namenode this is the error it logs...
>>> >
>>> > [hive@localhost ~]$ hadoop namenode
>>> > 12/08/09 20:56:57 INFO namenode.NameNode: STARTUP_MSG: >>> > /********************************************************= ****
>>> > STARTUP_MSG: Starting NameNode
>>> > STARTUP_MSG: =A0 host =3D localhost.localdomain/127.0.0.1
>>> > STARTUP_MSG: =A0 args =3D []
>>> > STARTUP_MSG: =A0 version =3D 0.20.2-cdh3u4
>>> > STARTUP_MSG: =A0 build =3D
>>> > file:///data/1/tmp/topdir/BUILD/hadoop-0.20.2-cdh3u4
>>> > -r 214dd731e3bdb687cb55988d3f47dd9e248c5690; compiled by = 'root' on Mon
>>> > May
>>> > 7 14:01:59 PDT 2012
>>> > *********************************************************= ***/
>>> > 12/08/09 20:56:57 INFO jvm.JvmMetrics: Initializing JVM M= etrics with
>>> > processName=3DNameNode, sessionId=3Dnull
>>> > 12/08/09 20:56:57 INFO metrics.NameNodeMetrics: Initializ= ing
>>> > NameNodeMeterics using context
>>> > object:org.apache.hadoop.metrics.spi.NoEmitMetricsContext=
>>> > 12/08/09 20:56:57 INFO util.GSet: VM type =A0 =A0 =A0 =3D= 64-bit
>>> > 12/08/09 20:56:57 INFO util.GSet: 2% max memory =3D 17.77= 875 MB
>>> > 12/08/09 20:56:57 INFO util.GSet: capacity =A0 =A0 =A0=3D= 2^21 =3D 2097152 entries
>>> > 12/08/09 20:56:57 INFO util.GSet: recommended=3D2097152, = actual=3D2097152
>>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: fsOwner=3Dh= ive (auth:SIMPLE)
>>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: supergroup= =3Dsupergroup
>>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: isPermissio= nEnabled=3Dfalse
>>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem:
>>> > dfs.block.invalidate.limit=3D1000
>>> > 12/08/09 20:56:57 INFO namenode.FSNamesystem: isAccessTok= enEnabled=3Dfalse
>>> > accessKeyUpdateInterval=3D0 min(s), accessTokenLifetime= =3D0 min(s)
>>> > 12/08/09 20:56:57 INFO metrics.FSNamesystemMetrics: Initi= alizing
>>> > FSNamesystemMetrics using context
>>> > object:org.apache.hadoop.metrics.spi.NoEmitMetricsContext=
>>> > 12/08/09 20:56:57 ERROR namenode.FSNamesystem: FSNamesyst= em
>>> > initialization
>>> > failed.
>>> > java.io.FileNotFoundException:
>>> > /var/lib/hadoop-0.20/cache/hadoop/dfs/name/in_use.lock (P= ermission
>>> > denied)
>>> > at java.io.RandomAccessFile.open(Native Method)
>>> > at java.io.RandomAccessFile.<init>(RandomAccessFile= .java:216)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.common.Storage$StorageDirec= tory.tryLock(Storage.java:614)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.common.Storage$StorageDirec= tory.lock(Storage.java:591)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.common.Storage$StorageDirec= tory.analyzeStorage(Storage.java:449)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTra= nsitionRead(FSImage.java:304)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFS= Image(FSDirectory.java:110)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initi= alize(FSNamesystem.java:372)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<i= nit>(FSNamesystem.java:335)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.initializ= e(NameNode.java:271)
>>> > at
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.<init&= gt;(NameNode.java:467)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.createNam= eNode(NameNode.java:1330)
>>> > at
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.main(Name= Node.java:1339)
>>> > 12/08/09 20:56:57 ERROR namenode.NameNode:
>>> > java.io.FileNotFoundException:
>>> > /var/lib/hadoop-0.20/cache/hadoop/dfs/name/in_use.lock (P= ermission
>>> > denied)
>>> > at java.io.RandomAccessFile.open(Native Method)
>>> > at java.io.RandomAccessFile.<init>(RandomAccessFile= .java:216)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.common.Storage$StorageDirec= tory.tryLock(Storage.java:614)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.common.Storage$StorageDirec= tory.lock(Storage.java:591)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.common.Storage$StorageDirec= tory.analyzeStorage(Storage.java:449)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTra= nsitionRead(FSImage.java:304)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFS= Image(FSDirectory.java:110)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initi= alize(FSNamesystem.java:372)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<i= nit>(FSNamesystem.java:335)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.initializ= e(NameNode.java:271)
>>> > at
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.<init&= gt;(NameNode.java:467)
>>> > at
>>> >
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.createNam= eNode(NameNode.java:1330)
>>> > at
>>> > org.apache.hadoop.hdfs.server.namenode.NameNode.main(Name= Node.java:1339)
>>> >
>>> > 12/08/09 20:56:57 INFO namenode.NameNode: SHUTDOWN_MSG: >>> > /********************************************************= ****
>>> > SHUTDOWN_MSG: Shutting down NameNode at localhost.localdo= main/127.0.0.1
>>> > *********************************************************= ***/
>>> >
>>> >
>>
>>


--bcaec529a17515438e04c6d4b887--