hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Devaraj k <devara...@huawei.com>
Subject RE: Multiple data node and namenode ?
Date Thu, 25 Jul 2013 08:55:14 GMT
It is the reason, you see two data node log files one with the old host name(which got created
before restart) and another with the new host name. 

Thanks
Devaraj k


-----Original Message-----
From: manishbhoge@rocketmail.com [mailto:manishbhoge@rocketmail.com] 
Sent: 25 July 2013 13:52
To: common-user@hadoop.apache.org
Subject: Re: Multiple data node and namenode ?

Yes I have change the hostname and restarted datanode

Sent via Rocket from my HTC 

----- Reply message -----
From: "Devaraj k" <devaraj.k@huawei.com>
To: "common-user@hadoop.apache.org" <common-user@hadoop.apache.org>
Subject: Multiple data node and namenode ?
Date: Thu, Jul 25, 2013 1:14 PM


I could see two data node's log files. But the modified times for both files are different
with the difference as 21 mins. I doubt whether they are really running. By any chance have
you updated the host name in the machine and then restarted the data node?

Could you check with 'ps -ef | grep datanode' shell command to know how many datanode processes
are running at this moment.

Thanks
Devaraj k


-----Original Message-----
From: Manish Bhoge [mailto:manishbhoge@rocketmail.com] 
Sent: 25 July 2013 12:56
To: common-user@hadoop.apache.org
Subject: Re: Multiple data node and namenode ?

Unfortunately, I don't have JPS installed. But as you can see it shows 2 data nodes.
 hadoop-hdfs-datanode-INBEDU011997A.log 243358 bytes Jul 25, 2013 2:29:15 AM hadoop-hdfs-datanode-myhost-1.log
1893692 bytes Jul 25, 2013 2:50:42 AM


is it because i have given 3 directory under dfs-data.dir in hdfs-site.xml?


________________________________
 From: Devaraj k <devaraj.k@huawei.com>
To: "common-user@hadoop.apache.org" <common-user@hadoop.apache.org>
Sent: Thursday, 25 July 2013 12:41 PM
Subject: RE: Multiple data node and namenode ?
 

Hi Manish,

  Can you check how many data node processes are running really in the machine using the
command 'jps' or 'ps'. 

Thanks
Devaraj k


-----Original Message-----
From: Manish Bhoge [mailto:manishbhoge@rocketmail.com] 
Sent: 25 July 2013 12:29
To: common-user@hadoop.apache.org
Subject: Multiple data node and namenode ?

I am configuring cluster and starting with first machine. So i have configured the core-site,
hdfs-site and mapred-site to run hadoop only on 1 machine. But somehow i am getting 2 copies
of data node, namenode and secondary namenode. Not able to figure out why ?



SecurityAuth-hdfs.audit 0 bytes Jul 17, 2013 4:34:56 AM hadoop-hdfs-datanode-INBEDU011997A.log
243358 bytes Jul 25, 2013 2:29:15 AM hadoop-hdfs-datanode-myhost-1.log 1893692 bytes Jul 25,
2013 2:50:42 AM hadoop-hdfs-namenode-INBEDU011997A.log 19545397 bytes Jul 25, 2013 2:50:40
AM hadoop-hdfs-namenode-myhost-1.log 2438271 bytes Jul 25, 2013 2:48:57 AM hadoop-hdfs-secondarynamenode-INBEDU011997A.log
4061047 bytes Jul 25, 2013 2:30:10 AM hadoop-hdfs-secondarynamenode-myhost-1.log 9707957 bytes
Jul 25, 2013 2:46:18 AM
Mime
View raw message