hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yogesh dhari <yogeshdh...@live.com>
Subject RE: HADOOP UPGRADE ISSUE
Date Thu, 22 Nov 2012 09:30:26 GMT

Hello Harsh..

Thanks for your suggestion :-), I need more guidance over it.

Terminal through I have run command 
hadoop namenode -upgrade (Say Terminal-1)

terminal-1 got stuck at this point.

12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 9 on 9000: starting
""and still cursor is blinking...""

Should I do stop it using ctrl+c command.  If I do so it will kill the process.

If I do open new terminal(say Terminal-2) and run JPS it shows
6374 NameNode
7615 Jps

As you mentioned to run hadoop fs -ls /
it shows all stored directories..( on Terminal-2 )
 
Now. Should I kill the process over Termial-1. What should I do to make it complete without
any loss of data..

I am attaching screen shot..  

Please have a look

Thanks & Regards
Yogesh Kumar








From: harsh@cloudera.com
Date: Thu, 22 Nov 2012 14:14:00 +0530
Subject: Re: HADOOP UPGRADE ISSUE
To: user@hadoop.apache.org

If your UI is already up, then NN is already functional. The UI merely shows that your upgrade
is done but has not been manually finalized by you (leaving it open for a rollback if needed).
You could try a simple "hadoop fs -ls /" to see if NN is functional, run some other regular
job based tests of yours, and then finalize the new format by issuing "hadoop dfsadmin -finalizeUpgrade"
to make the upgrade permanent (no rollback possible after this).



On Thu, Nov 22, 2012 at 1:49 PM, yogesh dhari <yogeshdhari@live.com> wrote:






Thanks Uma,

I used command 
hadoop namenode -upgrade and its started well but got stuck at one point.

12/11/22 13:06:19 INFO mortbay.log: Started SelectChannelConnector@localhost:50070
12/11/22 13:06:19 INFO namenode.NameNode: Web-server up at: localhost:50070


12/11/22 13:06:19 INFO ipc.Server: IPC Server Responder: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server listener on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 0 on 9000: starting


12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 1 on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 2 on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 3 on 9000: starting


12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 4 on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 5 on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 6 on 9000: starting


12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 7 on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 8 on 9000: starting
12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 9 on 9000: starting



from this point its not showing any progress for past 30 + mins...


and Web ui shows 

NameNode 'localhost:9000'


 	  
  Started:  Thu Nov 22 13:06:17 IST 2012
  Version:  1.0.4, r1393290
  Compiled:  Wed Oct  3 05:13:58 UTC 2012 by hortonfo
  Upgrades:  Upgrade for version -32 has been completed.
Upgrade is not finalized.

Please suggest

Regards
Yogesh Kumar




From: maheswara@huawei.com


To: user@hadoop.apache.org
Subject: RE: HADOOP UPGRADE ISSUE
Date: Thu, 22 Nov 2012 07:05:51 +0000








start-all.sh will not carry any arguments to pass to nodes.

Start with start-dfs.sh 

or start directly namenode with upgrade option. ./hadoop namenode -upgrade

 

Regards,

Uma



From: yogesh dhari [yogeshdhari@live.com]

Sent: Thursday, November 22, 2012 12:23 PM

To: hadoop helpforoum

Subject: HADOOP UPGRADE ISSUE






Hi All,



I am trying upgrading apache hadoop-0.20.2 to hadoop-1.0.4.

I have give same dfs.name.dir, etc as same in hadoop-1.0.4' conf files as were in hadoop-0.20.2.

Now I am starting dfs n mapred using



start-all.sh -upgrade



but namenode and datanode fail to run.



1) Namenode's logs shows::



ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.

java.io.IOException: 

File system image contains an old layout version -18.

An upgrade to version -32 is required.

Please restart NameNode with -upgrade option.

.

.

ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: 

File system image contains an old layout version -18.

An upgrade to version -32 is required.

Please restart NameNode with -upgrade option.





2) Datanode's logs shows:: 



WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect
permission for /opt/hadoop_newdata_dirr, expected: rwxr-xr-x, while actual: rwxrwxrwx

****(  how these file permission showing warnings)*****



2012-11-22 12:05:21,157 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: All directories
in dfs.data.dir are invalid.



Please suggest



Thanks & Regards

Yogesh Kumar








 		 	   		  


-- 
Harsh J

 		 	   		  
Mime
View raw message