hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brahma Reddy Battula <brahmareddy.batt...@huawei.com>
Subject RE: Set Hadoop MRv2 behind a NAT
Date Tue, 18 Feb 2014 12:15:35 GMT
Seems to be /etc/hosts mapping is missed b/w Namenode and DataNode machine..Please check hostmapping
is done with NAT'd IP or not...

DataNode IP :

Namenode IP :<>

Need to configure with above IP's

Thanks & Regards

Brahma Reddy Battula


From: xeon Mailinglist [xeonmailinglist@gmail.com]
Sent: Tuesday, February 18, 2014 5:32 PM
To: user@hadoop.apache.org
Subject: Set Hadoop MRv2 behind a NAT

I am trying to set Hadoop MapReduce (MRv2) behind the NAT, but when I try to connect the Datanode,
I get the error below.

The hosts have 2 interfaces, one with a private address and another with the NAT address.
To access the host with SSH, I must use an external IP, that NAT server will redirect.

I want to access MRv2 from outside,  and for that I tried to set an NAT'd IP, but the Datanado
don't starts. How I set the MRv2 address in the configuration files, so that I can put Hadoop

2014-02-18 11:55:43,105 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization
failed for block pool Block pool
 BP-1302615141- (storage id DS-1964144366-
service to /<>:
Datanode denied com
munication with namenode: DatanodeRegistration(, storageID=DS-1964144366-,
75, ipcPort=50020, storageInfo=lv=-40;cid=CID-f45cf960-4e55-420b-a20c-43f6edf1a847;nsid=1117538035;c=0)
        at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.registerDatanode(DatanodeManager.java:631)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerDatanode(FSNamesystem.java:3398)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:881)
        at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.registerDatanode(DatanodeProtocolServerSideTranslatorPB.java:90)
        at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:18295)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:454)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1741)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1737)
        at java.security.AccessController.doPrivileged(Native Method)

View raw message