Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.210.177 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAOcnVr3iym4T6TRf7jTLUxU2CHnpKEvSa7ENOFUVwk5M-xw2=A@mail.gmail.com>
References: <86DF8063-3F77-4D5D-B5BD-7DC9648CD367@keithwiley.com>
 <CAOcnVr3iym4T6TRf7jTLUxU2CHnpKEvSa7ENOFUVwk5M-xw2=A@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Tue, 19 Feb 2013 21:55:11 +0530
Message-ID: 
 <CAOcnVr2ibcBPorUdavSib0qs+99FWR60ba4VcdL086J1AMv9EQ@mail.gmail.com>
Subject: Re: Namenode formatting problem
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

To simplify my previous post, your IPs for the master/slave/etc. in
/etc/hosts file should match the ones reported by "ifconfig" always.
In proper deployments, IP is static. If IP is dynamic, we'll need to
think of some different ways.

On Tue, Feb 19, 2013 at 9:53 PM, Harsh J <harsh@cloudera.com> wrote:
> Hey Keith,
>
> I'm guessing whatever "ip-13-0-177-110" is resolving to (ping to
> check), is not what is your local IP on that machine (or rather, it
> isn't the machine you intended to start it on)?
>
> Not sure if EC2 grants static IPs, but otherwise a change in the
> assigned IP (checkable via ifconfig) would probably explain the
> "Cannot assign" error received when we tried a bind() syscall.
>
> On Tue, Feb 19, 2013 at 4:30 AM, Keith Wiley <kwiley@keithwiley.com> wrot=
e:
>> This is Hadoop 2.0.  Formatting the namenode produces no errors in the s=
hell, but the log shows this:
>>
>> 2013-02-18 22:19:46,961 FATAL org.apache.hadoop.hdfs.server.namenode.Nam=
eNode: Exception in namenode join
>> java.net.BindException: Problem binding to [ip-13-0-177-110:9212] java.n=
et.BindException: Cannot assign requested address; For more details see:  h=
ttp://wiki.apache.org/hadoop/BindException
>>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:71=
0)
>>         at org.apache.hadoop.ipc.Server.bind(Server.java:356)
>>         at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:454)
>>         at org.apache.hadoop.ipc.Server.<init>(Server.java:1833)
>>         at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:866)
>>         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(Protobu=
fRpcEngine.java:375)
>>         at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpc=
Engine.java:350)
>>         at org.apache.hadoop.ipc.RPC.getServer(RPC.java:695)
>>         at org.apache.hadoop.ipc.RPC.getServer(RPC.java:684)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.<ini=
t>(NameNodeRpcServer.java:238)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServ=
er(NameNode.java:452)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(Na=
meNode.java:434)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNo=
de.java:608)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNo=
de.java:589)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNod=
e(NameNode.java:1140)
>>         at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode=
.java:1204)
>> 2013-02-18 22:19:46,988 INFO org.apache.hadoop.util.ExitUtil: Exiting wi=
th status 1
>> 2013-02-18 22:19:46,990 INFO org.apache.hadoop.hdfs.server.namenode.Name=
Node: SHUTDOWN_MSG:
>> /************************************************************
>> SHUTDOWN_MSG: Shutting down NameNode at ip-13-0-177-11/127.0.0.1
>> ************************************************************/
>>
>> No java processes begin (although I wouldn't expect formatting the namen=
ode to start any processes, only starting the namenode or datanode should d=
o that), and "hadoop fs -ls /" gives me this:
>>
>> ls: Call From [CLIENT_HOST]/127.0.0.1 to [MASTER_HOST]:9000 failed on co=
nnection exception: java.net.ConnectException: Connection refused; For more=
 details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>>
>> My /etc/hosts looks like this:
>> 127.0.0.1   localhost localhost.localdomain CLIENT_HOST
>> MASTER_IP MASTER_HOST master
>> SLAVE_IP SLAVE_HOST slave01
>>
>> This is on EC2.  All of the nodes are in the same security group and the=
 security group has full inbound access.  I can ssh between all three machi=
nes (client/master/slave) without a password ala authorized_keys.  I can pi=
ng the master node from the client machine (although I don't know how to pi=
ng a specific port, such as the hdfs port (9000)).  Telnet doesn't behave o=
n EC2 which makes port testing a little difficult.
>>
>> Any ideas?
>>
>> ________________________________________________________________________=
________
>> Keith Wiley     kwiley@keithwiley.com     keithwiley.com    music.keithw=
iley.com
>>
>> "The easy confidence with which I know another man's religion is folly t=
eaches
>> me to suspect that my own is also."
>>                                            --  Mark Twain
>> ________________________________________________________________________=
________
>>
>
>
>
> --
> Harsh J


--
Harsh J