Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of dontariq@gmail.com designates
 209.85.216.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <4FBB230A.9000801@uci.cu>
References: <BAY148-W22BF95C5FBE2C40BF7CD9F86020@phx.gbl>
 <4FBB230A.9000801@uci.cu>
From: Mohammad Tariq <dontariq@gmail.com>
Date: Tue, 22 May 2012 13:03:17 +0530
Message-ID: 
 <CAMVC6ROygCMt2BwE3P-a6xNzXCTZMojwkOLAcz5n4npuwJJe8w@mail.gmail.com>
Subject: Re: namenode directory disappear after machines restart
To: hdfs-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hello Brendan,

  Do as suggested by Marcos..If you do not set these properties,
Hadoop uses "tmp" directory by default..Apart from setting these
properties in your hdfs-site.xml file add the following property in
your core-site.xml file -

<property>
	  <name>hadoop.tmp.dir</name>
	  <value>some_permanent_path</value>
</property>

Regards,
=A0=A0 =A0Mohammad Tariq


On Tue, May 22, 2012 at 10:54 AM, Marcos Ortiz <mlortiz@uci.cu> wrote:
> This is an usual behavior on Unix/Linux systems. When you restart the
> system, the content of the /tmp directory is cleaned, because precisely, =
the
> purpose of this directory is to keep files temporally.
> For that reason, the data directory for the HDFS filesystem should be
> another directory, /var/hadoop/data for example, of course, a directory
> durable in time.
> So, you should change your dfs.name.dir and your dfs.data.dir variable in
> your hdfs-site.xml.
>
> Regards
>
>
> On 05/21/2012 11:21 PM, Brendan cheng wrote:
>>
>> Hi,
>> I'm not sure if there is a setting to avoid the Namenode removed after
>> hosting machine of Namenode restart.I found that after successfully
>> installed single node pseudo distributed hadoop following from your webs=
ite,
>> the name node dir /tmp/hadoop-brendan/dfs/name are removed if machine
>> reboot.
>> What do I miss?
>> Brendan
>> 2012-05-22 11:14:05,678 INFO org.apache.hadoop.hdfs.server.common.Storag=
e:
>> Storage directory /tmp/hadoop-brendan/dfs/name does not exist.2012-05-22
>> 11:14:05,680 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
>> FSNamesystem initialization
>> failed.org.apache.hadoop.hdfs.server.common.InconsistentFSStateException=
:
>> Directory /tmp/hadoop-brendan/dfs/name is in an inconsistent state: stor=
age
>> directory does not exist or is not accessible. =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSI=
mage.java:303)
>> =A0 =A0 =A0 at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirecto=
ry.java:100)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesys=
tem.java:388)
>> =A0 =A0 =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.=
java:362)
>> =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java=
:276)
>> =A0 =A0 =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496=
)
>> =A0at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.=
java:1279)
>> =A0 at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)=
2012-05-22
>> 11:14:05,685 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode:
>> org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Direc=
tory
>> /tmp/hadoop-brendan/dfs/name is in an inconsistent state: storage direct=
ory
>> does not exist or is not accessible. at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSI=
mage.java:303)
>> =A0 =A0 =A0 at
>> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirecto=
ry.java:100)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesys=
tem.java:388)
>> =A0 =A0 =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.=
java:362)
>> =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java=
:276)
>> =A0 =A0 =A0 =A0at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496=
)
>> =A0at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.=
java:1279)
>> =A0 at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)
>>
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
>> INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>
>
> --
> Marcos Luis Ort=EDz Valmaseda
> =A0Data Engineer&& =A0Sr. System Administrator at UCI
> =A0http://marcosluis2186.posterous.com
> =A0http://www.linkedin.com/in/marcosluis2186
> =A0Twitter: @marcosluis2186
>
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS
> INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci