Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C537CDA7C for ; Wed, 8 Aug 2012 07:50:16 +0000 (UTC) Received: (qmail 34750 invoked by uid 500); 8 Aug 2012 07:50:12 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 34243 invoked by uid 500); 8 Aug 2012 07:50:08 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 34232 invoked by uid 99); 8 Aug 2012 07:50:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Aug 2012 07:50:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of prabhu.hadoop@gmail.com designates 209.85.161.176 as permitted sender) Received: from [209.85.161.176] (HELO mail-gg0-f176.google.com) (209.85.161.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 08 Aug 2012 07:50:02 +0000 Received: by ggcs6 with SMTP id s6so549861ggc.35 for ; Wed, 08 Aug 2012 00:49:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=uh7xYi0iubAykhpg0C3xVhAMds7StikRoYsLxpMthSs=; b=N+ALD1m3SiT5clhCZ5eHKi1+ZtmburXOBJCykzO1fCf9rwzL5BEKcl15V2bVyuyuVI 3FB4pzCxLT9Wk0hHok3Ng1djajVWHMahn02ulGQYShfANZbGNNd8e3nvUohxMlCpi5La 0kcNS8ERUlMCdLBUodU7e1W9pdLll3uGNH+QiIlLTKpxRvZ/9buNB1EeooggqYG7j9LK w0jfDAetk8b9yLQ4fbAFLgcq0ZO7piBs9ohbZKFJ8mN34Zn+zSxUMclDdvmih5cd31j8 3QF/Yrn7fCnjIH7A/cHOrZMxnqCZ/BYc7gyUZbzUSuY1oLGFaiDYKmrvG1RMCQI0C5X3 xyNA== MIME-Version: 1.0 Received: by 10.42.155.135 with SMTP id u7mr3793617icw.25.1344412182147; Wed, 08 Aug 2012 00:49:42 -0700 (PDT) Received: by 10.64.40.164 with HTTP; Wed, 8 Aug 2012 00:49:42 -0700 (PDT) Date: Wed, 8 Aug 2012 13:19:42 +0530 Message-ID: Subject: Data node error From: prabhu K To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=90e6ba6e8c5a8c720204c6bc5aac X-Virus-Checked: Checked by ClamAV on apache.org --90e6ba6e8c5a8c720204c6bc5aac Content-Type: text/plain; charset=ISO-8859-1 Hi Users, I have formatted hadoop cluster, formatted successfully. after stop &start hadoop, i hit the jps command in master, getting fine, but in slave machine am not getting data node, while see the data node log file, i am getting following error. Data node(slave1): 2012-08-08 00:16:44,033 WARN org.apache.hadoop.hdfs.server.datanode.DataBlockScanner: Second Verification failed for blk_-3831635302961953167_1690. Exception : java.io. IOException: Block blk_-3831635302961953167_1690 is not valid. at org.apache.hadoop.hdfs.server.datanode.FSDataset.getBlockFile(FSDataset.java:1072) at org.apache.hadoop.hdfs.server.datanode.FSDataset.getLength(FSDataset.java:1035) at org.apache.hadoop.hdfs.server.datanode.FSDataset.getVisibleLength(FSDataset.java:1045) at org.apache.hadoop.hdfs.server.datanode.BlockSender.(BlockSender.java:94) at org.apache.hadoop.hdfs.server.datanode.BlockSender.(BlockSender.java:81) at org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.verifyBlock(DataBlockScanner.java:453) at org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.verifyFirstBlock(DataBlockScanner.java:519) at org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockScanner.java:617) at java.lang.Thread.run(Thread.java:662) *data node(slave2)* 2012-08-08 13:03:50,195 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible namespaceIDs in /app/hadoop/tmp/dfs/data: namenode name spaceID = 1434906924; datanode namespaceID = 474761520 at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:232) at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:147) at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:385) at org.apache.hadoop.hdfs.server.datanode.DataNode.(DataNode.java:299) at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582) at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521) at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539) at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1665) at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1682) Please help me on this issue. Thanks, Prabhu. --90e6ba6e8c5a8c720204c6bc5aac Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi Users,
=A0
I have formatted hadoop cluster, formatted successfully. after stop &a= mp;start hadoop, i hit the jps command in master, getting fine, but in slav= e machine am not getting data node, while see the data node log file, i am = getting following error.
=A0
Data node(slave1):
2012-08-08 00:16:44,033 WARN org.apache.hadoop.hdfs.server.datanode.Da= taBlockScanner: Second Verification failed for blk_-3831635302961953167_169= 0. Exception : java.io.
IOException: Bloc= k blk_-3831635302961953167_1690 is not valid.
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.FSDataset.g= etBlockFile(FSDataset.java:1072)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.had= oop.hdfs.server.datanode.FSDataset.getLength(FSDataset.java:1035)
=A0=A0= =A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.FSDataset.getVisi= bleLength(FSDataset.java:1045)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.BlockSender= .<init>(BlockSender.java:94)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.h= adoop.hdfs.server.datanode.BlockSender.<init>(BlockSender.java:81)=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataBlockS= canner.verifyBlock(DataBlockScanner.java:453)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataBlockSc= anner.verifyFirstBlock(DataBlockScanner.java:519)
=A0=A0=A0=A0=A0=A0=A0 = at org.apache.hadoop.hdfs.server.datanode.DataBlockScanner.run(DataBlockSca= nner.java:617)
=A0=A0=A0=A0=A0=A0=A0 at java.lang.Thread.run(Thread.java= :662)

data node(slave2)=
2012-08-08 13:03:50,195 ERROR org.apache.hadoop.hdfs.server.datanode.D= ataNode: java.io.IOException: Incompatible namespaceIDs in /app/hadoop/tmp/= dfs/data: namenode name
spaceID =3D 1434906924; datanode namespaceID =3D= 474761520
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataStorage= .doTransition(DataStorage.java:232)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.= hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.j= ava:147)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode= .DataNode.startDataNode(DataNode.java:385)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.&l= t;init>(DataNode.java:299)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop= .hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
=A0=A0= =A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.instanti= ateDataNode(DataNode.java:1521)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.cr= eateDataNode(DataNode.java:1539)
=A0=A0=A0=A0=A0=A0=A0 at org.apache.had= oop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1665)
=A0=A0= =A0=A0=A0=A0=A0 at org.apache.hadoop.hdfs.server.datanode.DataNode.main(Dat= aNode.java:1682)
=A0
Please help me on this issue.
=A0
Thanks,
Prabhu.
--90e6ba6e8c5a8c720204c6bc5aac--