Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 78B207B95 for ; Fri, 22 Jul 2011 10:49:19 +0000 (UTC) Received: (qmail 82578 invoked by uid 500); 22 Jul 2011 10:49:18 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 82059 invoked by uid 500); 22 Jul 2011 10:49:09 -0000 Mailing-List: contact mapreduce-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: mapreduce-user@hadoop.apache.org Delivered-To: mailing list mapreduce-user@hadoop.apache.org Received: (qmail 81992 invoked by uid 99); 22 Jul 2011 10:49:06 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Jul 2011 10:49:06 +0000 X-ASF-Spam-Status: No, hits=-2.8 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_HI,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [192.134.164.82] (HELO mail1-relais-roc.national.inria.fr) (192.134.164.82) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Jul 2011 10:48:57 +0000 X-IronPort-AV: E=Sophos;i="4.67,247,1309730400"; d="scan'208,217";a="113692394" Received: from wifi-auth-189253.inria.fr ([128.93.189.253]) by mail1-relais-roc.national.inria.fr with ESMTP/TLS/AES128-SHA; 22 Jul 2011 12:48:37 +0200 From: Mohamed Riadh Trad Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: multipart/alternative; boundary=Apple-Mail-18-164871262 Subject: Problem Setting Cluster with no public nodes adresses Date: Fri, 22 Jul 2011 12:53:56 +0200 In-Reply-To: To: mapreduce-user@hadoop.apache.org References: Message-Id: X-Mailer: Apple Mail (2.1084) X-Virus-Checked: Checked by ClamAV on apache.org --Apple-Mail-18-164871262 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Dear all, I am trying to set up hadoop on a 18 node cluster. The problem is that cluster nodes do not have public IPs, such as, in = order to access node1, I had first to connect to the frontal node. Let a be the ip address of my frontal node. I have configured my .ssh/config with proxycommand: # Cluster Host node*.a ProxyCommand ssh -q a /usr/bin/nc `echo %h | cut -d"." -f1` 22 # and added 3 nodes in the masters conf/slave: node001.a node002.a node003.a then I have formatted my namenode and started dfs. the issue, is that when I look for datanodes, there is only one instead = of 3... the displayed datanode name changes every time that I want to = display the datanodes lit. Any Idea, how to resolve this issue?? I am suspecting the framework not differentiating hosts since I used the = proxycommand. Bests, Trad Mohamed Riadh, M.Sc, Ing. PhD. student INRIA-TELECOM PARISTECH - ENPC School of International Management Office: 11-15 Phone: (33)-1 39 63 59 33 Fax: (33)-1 39 63 56 74 Email: riadh.trad@inria.fr Home page: http://www-rocq.inria.fr/who/Mohamed.Trad/ --Apple-Mail-18-164871262 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii Dear = all,

I am trying to set up hadoop on a 18 node = cluster.

The problem is that cluster nodes do = not have public IPs, such as, in order to access node1, I had first to = connect to the frontal node.

Let a be the ip = address of my frontal node.

I have configured = my .ssh/config with proxycommand:

# = Cluster
Host node*.a
ProxyCommand ssh -q a = /usr/bin/nc `echo %h | cut -d"." -f1` = 22
#

and added 3 nodes in the = masters = conf/slave:
node001.a
node002.a
node003.a

then I have formatted my namenode and started = dfs.

the issue, is that when I look for = datanodes, there is only one instead of 3... the displayed datanode name = changes every time that I want to display the datanodes = lit.

Any Idea, how to resolve this = issue??

I am suspecting the framework not = differentiating hosts since I used the = proxycommand.

Bests,


Trad Mohamed = Riadh, M.Sc, Ing.
PhD. student
INRIA-TELECOM = PARISTECH - ENPC School of International = Management

Office: = 11-15
Phone: (33)-1 39 = 63 59 33
Fax: (33)-1 39 63 56 74
Home = page: 
= --Apple-Mail-18-164871262--