Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 76B5A10D54 for ; Tue, 18 Feb 2014 12:16:18 +0000 (UTC) Received: (qmail 61894 invoked by uid 500); 18 Feb 2014 12:16:10 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 61641 invoked by uid 500); 18 Feb 2014 12:16:09 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 61633 invoked by uid 99); 18 Feb 2014 12:16:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Feb 2014 12:16:08 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of brahmareddy.battula@huawei.com designates 119.145.14.65 as permitted sender) Received: from [119.145.14.65] (HELO szxga02-in.huawei.com) (119.145.14.65) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 18 Feb 2014 12:16:03 +0000 Received: from 172.24.2.119 (EHLO szxeml209-edg.china.huawei.com) ([172.24.2.119]) by szxrg02-dlp.huawei.com (MOS 4.3.7-GA FastPath queued) with ESMTP id BPZ78116; Tue, 18 Feb 2014 20:15:40 +0800 (CST) Received: from SZXEML451-HUB.china.huawei.com (10.82.67.194) by szxeml209-edg.china.huawei.com (172.24.2.184) with Microsoft SMTP Server (TLS) id 14.3.158.1; Tue, 18 Feb 2014 20:15:39 +0800 Received: from SZXEML510-MBX.china.huawei.com ([169.254.3.198]) by szxeml451-hub.china.huawei.com ([10.82.67.194]) with mapi id 14.03.0158.001; Tue, 18 Feb 2014 20:15:36 +0800 From: Brahma Reddy Battula To: "user@hadoop.apache.org" Subject: RE: Set Hadoop MRv2 behind a NAT Thread-Topic: Set Hadoop MRv2 behind a NAT Thread-Index: AQHPLKFZ5+ssZlGZw0yMJlxfeOc/2pq67AUA Date: Tue, 18 Feb 2014 12:15:35 +0000 Message-ID: <8AD4EE147886274A8B495D6AF407DF694B1D35E2@szxeml510-mbx.china.huawei.com> References: In-Reply-To: Accept-Language: en-US, zh-CN Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.18.144.148] Content-Type: multipart/alternative; boundary="_000_8AD4EE147886274A8B495D6AF407DF694B1D35E2szxeml510mbxchi_" MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Virus-Checked: Checked by ClamAV on apache.org --_000_8AD4EE147886274A8B495D6AF407DF694B1D35E2szxeml510mbxchi_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Seems to be /etc/hosts mapping is missed b/w Namenode and DataNode machine.= .Please check hostmapping is done with NAT'd IP or not... DataNode IP : 172.16.100.2 Namenode IP : 10.103.0.11 Need to configure with above IP's Thanks & Regards Brahma Reddy Battula ________________________________ From: xeon Mailinglist [xeonmailinglist@gmail.com] Sent: Tuesday, February 18, 2014 5:32 PM To: user@hadoop.apache.org Subject: Set Hadoop MRv2 behind a NAT I am trying to set Hadoop MapReduce (MRv2) behind the NAT, but when I try t= o connect the Datanode, I get the error below. The hosts have 2 interfaces, one with a private address and another with th= e NAT address. To access the host with SSH, I must use an external IP, that= NAT server will redirect. I want to access MRv2 from outside, and for that I tried to set an NAT'd I= P, but the Datanado don't starts. How I set the MRv2 address in the configu= ration files, so that I can put Hadoop running? 2014-02-18 11:55:43,105 FATAL org.apache.hadoop.hdfs.server.datanode.DataNo= de: Initialization failed for block pool Block pool BP-1302615141-172.16.100.1-1392724171451 (storage id DS-1964144366-172.16.= 100.2-50010-1392724135477) service to /10.103.0.11: 9000 org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.protoco= l.DisallowedDatanodeException): Datanode denied com munication with namenode: DatanodeRegistration(0.0.0.0, storageID=3DDS-1964= 144366-172.16.100.2-50010-1392724135477, infoPort=3D500 75, ipcPort=3D50020, storageInfo=3Dlv=3D-40;cid=3DCID-f45cf960-4e55-420b-a2= 0c-43f6edf1a847;nsid=3D1117538035;c=3D0) at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.re= gisterDatanode(DatanodeManager.java:631) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerData= node(FSNamesystem.java:3398) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registe= rDatanode(NameNodeRpcServer.java:881) at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTran= slatorPB.registerDatanode(DatanodeProtocolServerSideTranslatorPB.java:90) at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$Dat= anodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:18295= ) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoke= r.call(ProtobufRpcEngine.java:454) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1014) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1741) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1737) at java.security.AccessController.doPrivileged(Native Method) : --_000_8AD4EE147886274A8B495D6AF407DF694B1D35E2szxeml510mbxchi_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable

Seems to be /etc/hosts mapping is missed b/w Namenode and&nb= sp;DataNode machine..Please check hostmapping is done with NAT'd IP or not...

 

 

DataNode IP : 172.16.100.2

Namenode IP : 10.103.0.11

 

Need to configure with above IP's

 

 

 

Thanks & Regards

 

Brahma Reddy Battula

 

From: xeon Mailinglist [xeonmailinglist@gm= ail.com]
Sent: Tuesday, February 18, 2014 5:32 PM
To: user@hadoop.apache.org
Subject: Set Hadoop MRv2 behind a NAT

I am trying to set Hadoop MapReduce (MRv2) behind the NAT,= but when I try to connect the Datanode, I get the error below.

The hosts have 2 interfaces, one with a private address and another wi= th the NAT address. To access the host with SSH, I must use an external IP,= that NAT server will redirect.

I want to access MRv2 from outside,  and for that I tried to set = an NAT'd IP, but the Datanado don't starts. How I set the MRv2 address in t= he configuration files, so that I can put Hadoop running?

2014-02-18 11:55:43,105 FATAL org.apache.hadoop.hdfs.server.datanode.D= ataNode: Initialization failed for block pool Block pool
 BP-1302615141-172.16.100.1-1392724171451 (storage id DS-19641443= 66-172.16.100.2-50010-1392724135477) service to /10.103.0.11:
9000
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.pr= otocol.DisallowedDatanodeException): Datanode denied com
munication with namenode: DatanodeRegistration(0.0.0.0, storageID=3DDS= -1964144366-172.16.100.2-50010-1392724135477, infoPort=3D500
75, ipcPort=3D50020, storageInfo=3Dlv=3D-40;cid=3DCID-f45cf960-4e55-42= 0b-a20c-43f6edf1a847;nsid=3D1117538035;c=3D0)
        at org.apache.hadoop.hdfs.server.blockmana= gement.DatanodeManager.registerDatanode(DatanodeManager.java:631)
        at org.apache.hadoop.hdfs.server.namenode.= FSNamesystem.registerDatanode(FSNamesystem.java:3398)
        at org.apache.hadoop.hdfs.server.namenode.= NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:881)
        at org.apache.hadoop.hdfs.protocolPB.Datan= odeProtocolServerSideTranslatorPB.registerDatanode(DatanodeProtocolServerSi= deTranslatorPB.java:90)
        at org.apache.hadoop.hdfs.protocol.proto.D= atanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(Datanode= ProtocolProtos.java:18295)
        at org.apache.hadoop.ipc.ProtobufRpcEngine= $Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:454)
        at org.apache.hadoop.ipc.RPC$Server.call(R= PC.java:1014)
        at org.apache.hadoop.ipc.Server$Handler$1.= run(Server.java:1741)
        at org.apache.hadoop.ipc.Server$Handler$1.= run(Server.java:1737)
        at java.security.AccessController.doPrivil= eged(Native Method)
:

--_000_8AD4EE147886274A8B495D6AF407DF694B1D35E2szxeml510mbxchi_--