Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 80A13FB52 for ; Wed, 1 May 2013 18:53:05 +0000 (UTC) Received: (qmail 34275 invoked by uid 500); 1 May 2013 18:53:00 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 34153 invoked by uid 500); 1 May 2013 18:53:00 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 34137 invoked by uid 99); 1 May 2013 18:53:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 May 2013 18:53:00 +0000 X-ASF-Spam-Status: No, hits=3.2 required=5.0 tests=DEAR_SOMETHING,HTML_FONT_SIZE_LARGE,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,URIBL_DBL_REDIR X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of dontariq@gmail.com designates 209.85.128.180 as permitted sender) Received: from [209.85.128.180] (HELO mail-ve0-f180.google.com) (209.85.128.180) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 01 May 2013 18:52:54 +0000 Received: by mail-ve0-f180.google.com with SMTP id pb11so1449009veb.11 for ; Wed, 01 May 2013 11:52:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=Y7MiRig3G12/GPAHN2tlDqdcmE6JW68VgmbIgZe/KIg=; b=u5KpINQy12ipkusdyv0jG3Nk2xVu7lJoegw1BvB8v9cPiauCYtd4nonAN3Mdi4jLWJ b9+R++py+t+TMQ2fhreZYEZH+IMa7JstYVaPZx0NtGtMuIcC0RGMRfi4H5uVWoqsjut+ YFa5ETzIrxJaCWeiiXwluOZxtci6B7cVTzNCqN/HOoQX7hvx/GJtlWCYfKP4muHaMJ5W 9YH8JMq3pwoJRXvtEpXbmuJGcx52aXzN+7jjJuAB7iPX2lmkmA36IeWOR2Jc8AjqmjDh NbUr+RkWej7HNYKH70uAYMrMagsgXlX2HAey75OTJM3Dqyd0XrutkiUWOhl37qUovJIE 0SoQ== X-Received: by 10.220.53.138 with SMTP id m10mr1194154vcg.29.1367434354121; Wed, 01 May 2013 11:52:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.58.220.194 with HTTP; Wed, 1 May 2013 11:51:53 -0700 (PDT) In-Reply-To: References: <1367421053304.dfdfe55a@Nodemailer> From: Mohammad Tariq Date: Thu, 2 May 2013 00:21:53 +0530 Message-ID: Subject: Re: there is not data-node To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a11c2c728ee994904dbac9e0a X-Virus-Checked: Checked by ClamAV on apache.org --001a11c2c728ee994904dbac9e0a Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Have you reformatted the NN(unsuccessfully)?Was your NN serving some other cluster earlier or your DNs were part of some other cluster?Datanodes bind themselves to namenode through namespaceID and in your case the IDs of DNs and NN seem to be different. As a workaround you could do this : 1- Stop all the daemons. 2- Go to the directory which you have specified as the value of "dfs.name.d= ir" property in your hdfs-site.xml file. 3- You'll find a directory called "current" inside this directory where a file named "VERSION" will be present. Open this file and copy the value of = " namespaceID" form here. 4- Now go to the directory which you have specified as the value of "dfs.data.dir" property in your hdfs-site.xml file. 5- Move inside the "current" directory and open the "VERSION" file here as well. Now replace the value of "namespaceID" present here with the one you had copied earlier. 6- Restart all the daemons. Note : If you have not created dfs.name.dir and dfs.data.dir separately, you could find all this inside your temp directory. HTH Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, May 2, 2013 at 12:13 AM, shashwat shriparv < dwivedishashwat@gmail.com> wrote: > Format your namenode and start again > > *Thanks & Regards * > > =E2=88=9E > Shashwat Shriparv > > > > On Wed, May 1, 2013 at 8:40 PM, =E5=A7=9A=E5=90=89=E9=BE=99 wrote: > >> Id is different in namenode and data node.you can modify the id.I met th= e >> same issue and I completely remove all file under hadoop >> =E2=80=94 >> Sent from Mailbox for iPhone >> >> >> On Wed, May 1, 2013 at 8:32 PM, Mohsen B.Sarmadi < >> mohsen.bsarmadi@gmail.com> wrote: >> >>> Dear Sirs/madams >>> >>> i am trying to run hadoop 1.0.4 in the pseudo distributed mode, but i a= m >>> facing with >>> >>> datanode log, >>> >>> 01/05/2013 13:16:54 2013-05-01 13:16:54,206 ERROR >>> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: >>> Incompatible namespaceIDs in /home/mohs/hadoop/dfsdirdata: namenode >>> namespaceID =3D 717658700; datanode namespaceID =3D 1318489331 >>> >>> >>> job-tracker log: >>> >>> 01/05/2013 13:24:40 org.apache.hadoop.ipc.RemoteException: >>> java.io.IOException: File /home/mohs/hadoop/tmp/mapred/system/ >>> jobtracker.info could only be replicated to 0 nodes, instead of 1 >>> >>> data-node log: >>> 01/05/2013 13:26:10 2013-05-01 13:26:09,711 WARN >>> org.apache.hadoop.hdfs.DFSClient: DataStreamer Exception: >>> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File >>> /home/mohs/hadoop/tmp/mapred/system/jobtracker.info could only be >>> replicated to 0 nodes, instead of 1 >>> >>> i have tried to solve this by removing the files in /tmp/hadoop/* and >>> running hadoop namenode -format >>> >>> but i am facing with the same error. >>> do you have any solution for this? >>> >>> regards >>> Mohsen >>> >>> >>> >>> >> > --001a11c2c728ee994904dbac9e0a Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
=C2=A0=C2=A0 =C2=A0 Have you reformatted the NN(unsuccessfully)?Was your N= N serving some other cluster earlier or your DNs were part of some other cl= uster?Datanodes bind themselves to namenode through=C2=A0n= amespaceID=C2=A0and in your case the IDs of DNs and NN seem to be di= fferent. As a workaround you could do this :

1- Stop all the daemon= s.
2- Go to= the directory which you have specified as the value of "dfs.name.dir" property in your hdfs-site.xml file.
3- You'll fi= nd a directory called "current" inside this directory where a fil= e named "VERSION" will be present. Open this file and copy the va= lue of "namespaceID" form here.
4- Now go to the= directory which you have specified as the value of "dfs.data.dir"= ; property in your hdfs-site.xml file.
5- Move inside the "current" directory and open the "VERSION= " file here as well. Now replace the value of "n= amespaceID" present here with the one you had copied earlier.
6- Restart all t= he daemons.

Note = : If you have not created dfs.name.dir and dfs.data= .dir separately, you could find all this inside your temp directory.

=
HTH
<= div class=3D"gmail_extra">


On Thu, May 2, 2013 at 12:13 AM, shashwa= t shriparv <dwivedishashwat@gmail.com> wrote:
Format your namenode and start again

Th= anks & Regards =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=20 =09 =09 =09 =09

<= font size=3D"6">=E2=88=9E

Shash= wat Shriparv



On Wed, May 1, 2013 at 8:40 PM, =E5=A7= =9A=E5=90=89=E9=BE=99 <geelongyao@gmail.com> wrote:
Id is different in namenode and data node.you can modify the id.I met = the same issue and I completely remove all =C2=A0file under hadoop
=E2=80=94
Sent from Mailbox for iPhone


On Wed, May 1, 2013 at 8:32= PM, Mohsen B.Sarmadi <mohsen.bsarmadi@gmail.com> wr= ote:

Dear Sirs/madams

i am trying to run hadoop 1.0.4 in the pseudo distr= ibuted=C2=A0mode, but i am facing with=C2=A0

datanode log,

01/05/2013 13:16= :54 2013-05-01 13:16:54,206 E= RROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: = Incompatible namespaceIDs in /home/mohs/hadoop/dfsdirdata: namenode namespa= ceID =3D 717658700; datanode namespaceID =3D 1318489331


job-tracker log:
<= br>
01/05/2013 13:24:40= org.apache.hadoop.ipc.RemoteException: java.io.IOException: File = /home/mohs/hadoop/tmp/mapred/system/jobtracker.info could only be replicated to 0 nodes, inst= ead of 1

data-node log:
01/05/2013 13:26:10 2013-05-01 13:26:09,711 WARN org.a= pache.hadoop.hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.= RemoteException: java.io.IOException: File /home/mohs/hadoop/tmp/mapred/sys= tem/jobtracker.info could only be replicated to 0 nodes, instead of 1

i have tried to solve this by removing the files in /tm= p/hadoop/* and running hadoop namenode -format

but= i am facing with the same error.
do you have any solution for th= is?

regards
Mohsen


<= /div>




--001a11c2c728ee994904dbac9e0a--