Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 467B69D9E for ; Wed, 8 Aug 2012 14:03:20 +0000 (UTC) Received: (qmail 4213 invoked by uid 500); 8 Aug 2012 14:03:15 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 4118 invoked by uid 500); 8 Aug 2012 14:03:15 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 4110 invoked by uid 99); 8 Aug 2012 14:03:15 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Aug 2012 14:03:15 +0000 X-ASF-Spam-Status: No, hits=2.8 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_REPLY,FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of sandeepreddy.3647@gmail.com designates 209.85.212.182 as permitted sender) Received: from [209.85.212.182] (HELO mail-wi0-f182.google.com) (209.85.212.182) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Aug 2012 14:03:10 +0000 Received: by wibhq12 with SMTP id hq12so581700wib.11 for ; Wed, 08 Aug 2012 07:02:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=iVS18/VBDAeX7RSyM62yrGkh+BT1gK4qBxI4rAc7W/s=; b=ggY5ZfK1ARgt5hszjo8xEwKeqWxVMgqHqfM4x4AQ+GItUHJnFyxo/WAz7LpBPKqoGx /KJCDySvcA1v5al/hDrGtENx6PVCwx8eJG/ZbC8CH3VjVIS8h7b0ZLUrmofi6U64Tg96 uN31hVHTJkjTLaa7ecZa3aSuTxkfB1L36ZgbGOQk4u3NTCSNQh5VoJCVXxzmjmMSyssI eiXg9klte0ne54nn5f8zMDs5701CXCR+FFhH8aQo1pohG2iBYAm1SxAOm9pmHDJ0RwC+ urz0D+JZHWayXlUzgIQtgyqylGLNqvsInmVl9CKSkhX3fNdscR+/6YstPcnokSvCnX8e XbAA== MIME-Version: 1.0 Received: by 10.180.84.104 with SMTP id x8mr2955666wiy.20.1344434569286; Wed, 08 Aug 2012 07:02:49 -0700 (PDT) Received: by 10.194.36.130 with HTTP; Wed, 8 Aug 2012 07:02:49 -0700 (PDT) In-Reply-To: References: Date: Wed, 8 Aug 2012 10:02:49 -0400 Message-ID: Subject: Re: Data node error From: Sandeep Reddy P To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=f46d043bd758ed15cf04c6c19006 X-Virus-Checked: Checked by ClamAV on apache.org --f46d043bd758ed15cf04c6c19006 Content-Type: text/plain; charset=ISO-8859-1 Hi, Just edit the namespace id in datanode. In your case it'll be in the dfs.data.dir vi /app/hadoop/tmp/dfs/data/current/VERSION Replace namespace id 474761520(datanode namespace id) with 1434906924 (namenode name space id) On Wed, Aug 8, 2012 at 4:15 AM, Chandra Mohan, Ananda Vel Murugan < Ananda.Murugan@honeywell.com> wrote: > For incompatible namespaceid error, there are two solutions available > here. **** > > ** ** > > > http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/ > **** > > ** ** > > I ran into this same issue and second solution fixed it. **** > > ** ** > > ** ** > ------------------------------ > > *From:* anil gupta [mailto:anilgupta84@gmail.com] > *Sent:* Wednesday, August 08, 2012 1:36 PM > *To:* user@hadoop.apache.org > *Subject:* Re: Data node error**** > > ** ** > > This link might provide you some more information: > http://mail-archives.apache.org/mod_mbox/hadoop-common-user/201203.mbox/%3CCAAu13zHcMeUThvA9OPN9MeMyvE9SHxsD1gSdZnZOWs3qrQZaNQ@mail.gmail.com%3E > > HTH, > Anil**** > > On Wed, Aug 8, 2012 at 12:56 AM, anil gupta wrote: > **** > > Hi Prabhu, > > Did you clean the data dir on DataNodes? Whenever Namenode is formated the > data directories of Datanodes needs to be cleaned up. As far as i remember > it's the directory which you mention in dfs.data.dir in hdfs-site.xml > file.You can do a google search for the error and you can get more details. > (Sorry, i dont have access to my cluster conf right now for telling you > the exact property). > > Thanks, > Anil**** > > ** ** > > On Wed, Aug 8, 2012 at 12:49 AM, prabhu K wrote: > **** > > Hi Users,**** > > **** > > I have formatted hadoop cluster, formatted successfully. after stop &start > hadoop, i hit the jps command in master, getting fine, but in slave machine > am not getting data node, while see the data node log file, i am getting > following error.**** > > **** > > Data node(slave1):**** > > 2012-08-08 00:16:44,033 WARN > org.apache.hadoop.hdfs.server.datanode.DataBlockScanner: Second > Verification failed for blk_-3831635302961953167_1690. Exception : java.io > . > IOException: Block blk_-3831635302961953167_1690 is not valid. > at > org.apache.hadoop.hdfs.server.datanode.FSDataset.getBlockFile(FSDataset.java:1072) > at > org.apache.hadoop.hdfs.server.datanode.FSDataset.getLength(FSDataset.java:1035) > at > org.apache.hadoop.hdfs.server.datanode.FSDataset.getVisibleLength(FSDataset.java:1045) > at > org.apache.hadoop.hdfs.server.datanode.BlockSender.(BlockSender.java:94) > at > org.apache.hadoop.hdfs.server.datanode.BlockSender.(BlockSender.java:81) > at > org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.verifyBlock(DataBlockScanner.java:453) > at > org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.verifyFirstBlock(DataBlockScanner.java:519) > at > org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:617) > at java.lang.Thread.run(Thread.java:662)**** > > > *data node(slave2)***** > > 2012-08-08 13:03:50,195 ERROR > org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: > Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode name > spaceID = 1434906924; datanode namespaceID = 474761520 > at > org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232) > at > org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:299) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1665) > at > org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1682)** > ** > > **** > > Please help me on this issue.**** > > **** > > Thanks,**** > > Prabhu.**** > > > > **** > > -- > Thanks & Regards, > Anil Gupta**** > > > > > -- > Thanks & Regards, > Anil Gupta**** > -- Thanks, sandeep --f46d043bd758ed15cf04c6c19006 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi,
Just edit the namespace id in datanode. In your case it'll be in= the dfs.data.dir
vi /app/hadoop/tmp/dfs/data/current/VERSION
Replac= e namespace id 474761520(datanode namespace id) with 14349069= 24 (namenode name space id)

On Wed, Aug 8, 2012 at 4:15 AM, Chandra Moha= n, Ananda Vel Murugan <Ananda.Murugan@honeywell.com> wrote:

For incompatible namespac= eid error, there are two solutions available here.

=A0<= /font>

http://www.michael-noll.com/tutorials/running-hadoop-on-= ubuntu-linux-multi-node-cluster/

=A0<= /font>

I ran into this same issu= e and second solution fixed it.

=A0<= /font>

=A0<= /font>

From: anil gupta= [mailto:anilgup= ta84@gmail.com]
Sent: Wednesday, August 08, = 2012 1:36 PM
To: user@hadoop.apache.org
Subject: Re: Data node error=

=A0

This link might provi= de you some more information: http://mail-archives.apache.org/mod_mbox/hadoop-common-user/201203.mbox/%3C= CAAu13zHcMeUThvA9OPN9MeMyvE9SHxsD1gSdZnZOWs3qrQZaNQ@mail.gmail.com%3E
HTH,
Anil

On Wed, Aug 8, 2012 at 12:56 AM, anil gupta <anilgupta84@gmail.co= m> wrote:

Hi Prabhu,

Did you clean the data dir on DataNodes? Whenever Namenode is formated the = data directories of Datanodes needs to be cleaned up. As far as i remember = it's the directory which you mention in dfs.data.dir in hdfs-site.xml f= ile.You can do a google search for the error and you can get more details.
(Sorry, i dont have access to my cluster conf right now for telling you the= exact property).

Thanks,
Anil

=A0

On Wed, Aug 8, 2012 at 12:49 AM, prabhu K <prabhu.hadoop@gmail.= com> wrote:

Hi Users,

=A0

I have formatted hadoop cluster, formatted successfu= lly. after stop &start hadoop, i hit the jps command in master, getting= fine, but in slave machine am not getting data node, while see the data node log file, i am getting following error.=

=A0

Data node(slave1):<= u>

2012-08-08 00:16:44,033 WARN org.apache.hadoop.hdfs.= server.datanode.DataBlockScanner: Second Verification failed for blk_-38316= 35302961953167_1690. Exception : java.io.
IOException: Block blk_-3831635302961953167_1690 is not valid.
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.FSDataset.g= etBlockFile(FSDataset.java:1072)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.FSDataset.g= etLength(FSDataset.java:1035)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.FSDataset.g= etVisibleLength(FSDataset.java:1045)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.BlockSender= .<init>(BlockSender.java:94)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.BlockSender= .<init>(BlockSender.java:81)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataBlockSc= anner.verifyBlock(DataBlockScanner.java:453)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataBlockSc= anner.verifyFirstBlock(DataBlockScanner.java:519)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataBlockSc= anner.run(DataBlockScanner.java:617)
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java:662)


data node(slave2)

2012-08-08 13:03:50,195 ERROR org.apache.hadoop.hdfs= .server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs i= n /app/hadoop/tmp/dfs/data: namenode name
spaceID =3D 1434906924; datanode namespaceID =3D 474761520
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataStorage= .doTransition(DataStorage.java:232)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataStorage= .recoverTransitionRead(DataStorage.java:147)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.st= artDataNode(DataNode.java:385)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.&l= t;init>(DataNode.java:299)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.ma= keInstance(DataNode.java:1582)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.in= stantiateDataNode(DataNode.java:1521)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.cr= eateDataNode(DataNode.java:1539)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.se= cureMain(DataNode.java:1665)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.ma= in(DataNode.java:1682)

=A0

Please help me on this issue.

=A0

Thanks,

Prabhu.



-- =
Thanks & Regards,
Anil Gupta




--
Thanks & Regards,
Anil Gupta




--
Thanks,
sandeep
<= br> --f46d043bd758ed15cf04c6c19006--