Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9A3B87590 for ; Fri, 16 Sep 2011 08:54:04 +0000 (UTC) Received: (qmail 94003 invoked by uid 500); 16 Sep 2011 08:54:03 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 93962 invoked by uid 500); 16 Sep 2011 08:54:03 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 93954 invoked by uid 99); 16 Sep 2011 08:54:03 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Sep 2011 08:54:03 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,SPF_PASS,WEIRD_PORT X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of kiranprasad.g@imimobile.com designates 203.199.178.220 as permitted sender) Received: from [203.199.178.220] (HELO IMIMAIL03.imidomain.com) (203.199.178.220) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Sep 2011 08:53:59 +0000 Received: from kiranprasadg ([10.0.1.235]) by IMIMAIL03.imidomain.com with Microsoft SMTPSVC(6.0.3790.4675); Fri, 16 Sep 2011 14:24:49 +0530 Message-ID: <39318A0F3A3B4775ADD393EC68674870@imidomain.com> From: "kiranprasad" To: , References: <985A9458C4A24344A4542C7878413D17@imidomain.com> In-Reply-To: Subject: Re: While starting HDFS process getting stucked. Date: Fri, 16 Sep 2011 14:24:49 +0530 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_NextPart_000_0264_01CC747C.6464B4F0" X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 15.4.3508.1109 X-MimeOLE: Produced By Microsoft MimeOLE V15.4.3508.1109 X-OriginalArrivalTime: 16 Sep 2011 08:54:49.0769 (UTC) FILETIME=[4AC66990:01CC744E] This is a multi-part message in MIME format. ------=_NextPart_000_0264_01CC747C.6464B4F0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Yes I ve formatted the namenode. From: Sudharsan Sampath=20 Sent: Friday, September 16, 2011 2:11 PM To: hdfs-user@hadoop.apache.org=20 Subject: Re: While starting HDFS process getting stucked. Have u formatted ur namenode ?=20 Thanks Sudhan S On Fri, Sep 16, 2011 at 11:01 AM, kiranprasad = wrote: Hi I am new to Hadoop and PIG, For Cluster I have 3 VMs(10.0.0.61-master, 10.0.0.62,10.0.0.63 - = Slaves) I ve installed PIG in 10.0.0.61 VM.=3D20 Hadoop version : hadoop-0.20.2 and PIG : pig-0.8.1 I ve updated the xmls , please find the below mapred site.xml -------------- mapred.job.tracker 10.0.0.61:8021 core-site.xml ---------- fs.default.name hdfs://10.0.0.61:8020 Hdfs-site.xml ---------------- fs.default.name hdfs://10.0.0.61:8020 mapred.job.tracker 10.0.0.61:8021 dfs.replication 2 masters --------- 10.0.0.61 slaves -------- 10.0.0.62 10.0.0.63 I ve tried with hadoop fs -ls but still facing the same problem. [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/start-all.sh starting namenode, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-nameno= =3D de-pig4.out 10.0.0.62: starting datanode, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datano= =3D de-pig3.out 10.0.0.63: starting datanode, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-datano= =3D de-pig2.out 10.0.0.61: starting secondarynamenode, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-second= =3D arynamenode-pig4.out starting jobtracker, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-jobtra= =3D cker-pig4.out 10.0.0.63: starting tasktracker, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktr= =3D acker-pig2.out 10.0.0.62: starting tasktracker, logging to = /home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-tasktr= =3D acker-pig3.out [kiranprasad.g@pig4 hadoop-0.20.2]$ [kiranprasad.g@pig4 hadoop-0.20.2]$ [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls After this it stopped running, it got stucked. Regards Kiran.G ------=_NextPart_000_0264_01CC747C.6464B4F0 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Yes I ve formatted the namenode.
 
Have=20 u formatted ur namenode ?=20
 
Thanks
Sudhan S

On Fri, Sep 16, 2011 at 11:01 AM, kiranprasad = <kiranprasad.g@imimobile.com>=20 wrote:
Hi

I  am new to Hadoop and = PIG,

For=20 Cluster I have 3 VMs(10.0.0.61-master, 10.0.0.62,10.0.0.63 - = Slaves)

I=20 ve installed PIG in 10.0.0.61 VM.=3D20

Hadoop version : = hadoop-0.20.2=20 and  PIG  : pig-0.8.1
I ve updated the xmls , please find = the=20 below

mapred=20 site.xml
--------------
<configuration>
 =20 <property>
       =20 <name>mapred.job.tracker</**name>
  = <value>10.0.0.61:8021</value>
 =20 = </property>
</configuration>


core-site.xml
-= ---------
<configuration>
 =20 <property>
   <name>fs.default.name</name>
  =20 <value>hdfs://10.0.0.61:8020</**value>

 =20 = </property>
</configuration>

Hdfs-site.xml
-----= -----------
<configuration>
<property>
 =20 <name>fs.default.name</name>
 =20 <value>hdfs://10.0.0.61:8020</**value>
</property><property>
 =20 <name>mapred.job.tracker</**name>
  = <value>10.0.0.61:8021</value>

</property>=
<property>
  =20 <name>dfs.replication</name>
  =20 = <value>2</value>
</property>

masters
-----= ----
10.0.0.61

slaves
--------

10.0.0.62
10.0.0.63=


I=20 ve tried with hadoop fs -ls but still facing the same=20 problem.

[kiranprasad.g@pig4 hadoop-0.20.2]$=20 bin/start-all.sh
starting namenode, logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= nameno=3D
de-pig4.out
10.0.0.62: starting = datanode,=20 logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= datano=3D
de-pig3.out
10.0.0.63: starting = datanode,=20 logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= datano=3D
de-pig2.out
10.0.0.61: starting=20 secondarynamenode, logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= second=3D
arynamenode-pig4.out
starting=20 jobtracker, logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= jobtra=3D
cker-pig4.out
10.0.0.63: starting = tasktracker,=20 logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= tasktr=3D
acker-pig2.out
10.0.0.62: starting = tasktracker,=20 logging=20 = to
/home/kiranprasad.g/hadoop-0.20.2/bin/../logs/hadoop-kiranprasad.g-= tasktr=3D
acker-pig3.out
[kiranprasad.g@pig4=20 hadoop-0.20.2]$
[kiranprasad.g@pig4 = hadoop-0.20.2]$
[kiranprasad.g@pig4=20 hadoop-0.20.2]$ bin/hadoop fs -ls

After this it stopped = running, it got=20 stucked.

Regards
Kiran.G
 
------=_NextPart_000_0264_01CC747C.6464B4F0--