Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 625601016D for ; Mon, 23 Sep 2013 17:50:59 +0000 (UTC) Received: (qmail 3199 invoked by uid 500); 23 Sep 2013 17:50:52 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 2883 invoked by uid 500); 23 Sep 2013 17:50:51 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 2875 invoked by uid 99); 23 Sep 2013 17:50:51 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Sep 2013 17:50:51 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of manickam.p@outlook.com designates 65.54.190.81 as permitted sender) Received: from [65.54.190.81] (HELO bay0-omc2-s6.bay0.hotmail.com) (65.54.190.81) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 Sep 2013 17:50:46 +0000 Received: from BAY176-W52 ([65.54.190.123]) by bay0-omc2-s6.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Mon, 23 Sep 2013 10:50:25 -0700 X-TMN: [BnHxSCxgqXjb7SrRLf3L83/t7BGsSPM4nRgXdvkW6i4=] X-Originating-Email: [manickam.p@outlook.com] Message-ID: Content-Type: multipart/alternative; boundary="_7d718dc8-c2a6-47da-8cf5-5324f51b2892_" From: Manickam P To: "user@hadoop.apache.org" Subject: RE: HDFS federation Configuration Date: Mon, 23 Sep 2013 23:20:25 +0530 Importance: Normal In-Reply-To: References: ,,, MIME-Version: 1.0 X-OriginalArrivalTime: 23 Sep 2013 17:50:25.0482 (UTC) FILETIME=[620292A0:01CEB885] X-Virus-Checked: Checked by ClamAV on apache.org --_7d718dc8-c2a6-47da-8cf5-5324f51b2892_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi=2C I got couple of doubts while doing this. Please help me to understand that. How to generate or find out the the cluster id for the below step? I saw th= at for one node we can format without this cluster id and we need to pass s= ame cluster id which got generated for the other name node while formatting= or else we could not get the federated cluster. $HADOOP_PREFIX_HOME/bin/hd= fs namenode -format -clusterId In my case i want to have two na= me nodes and 3 data nodes. Do i need to mention all the data nodes ip addre= ss in the slave files in two name nodes?=20 Thanks=2CManickam P Date: Mon=2C 23 Sep 2013 10:02:42 -0700 Subject: Re: HDFS federation Configuration From: suresh@hortonworks.com To: user@hadoop.apache.org I'm not able to follow the page completely.=20 =0A= Can you pls help me to get some clear step by step or little bit more detai= ls in the configuration side?=20 Have you setup a non-federated cluster before. If you have=2C the page shou= ld be easy to follow. If you have not setup a non-federated cluster before= =2C I suggest doing so=2C before looking at this document.=0A= I think the document already has step by step instructions.I=0A= =0A= =0A= =0A= =0A= CONFIDENTIALITY NOTICENOTICE: This message is intended for the use of the i= ndividual or entity to which it is addressed and may contain information th= at is confidential=2C privileged and exempt from disclosure under applicabl= e law. If the reader of this message is not the intended recipient=2C you a= re hereby notified that any printing=2C copying=2C dissemination=2C distrib= ution=2C disclosure or forwarding of this communication is strictly prohibi= ted. If you have received this communication in error=2C please contact the= sender immediately and delete it from your system. Thank You. = --_7d718dc8-c2a6-47da-8cf5-5324f51b2892_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
Hi=2C

I got couple of doubts while doing this. Please help me to understand that= .

How to generate or find out= the the cluster id for the below step? I saw that for one node we can form= at without this cluster id and we need to pass same cluster id which got ge= nerated for the other name node while formatting or else we could not get t= he federated cluster.
 $HADOOP_PREFIX_HOME/bin/hdfs namenode -format -cl=
usterId <=3Bcluster_id>=3B
In my case i want to have two name nodes and 3 data nodes. Do i ne=
ed to mention all the data nodes ip address in the slave files in two name =
nodes?


Thanks=2C
Manickam P<= br>
Date: Mon=2C 23 Sep 2013 10:02:42 -0700=
Subject: Re: HDFS federation Configuration
From: suresh@hortonworks.= com
To: user@hadoop.apache.org



I'm not able to follow the page c= ompletely.
=0A= Can you pls help me to get some clear step by step or little bit more detai= ls in the configuration side?

=
Have you setup a non-federated cluster before. If you have=2C th= e page should be easy to follow. If you have not setup a non-federated clus= ter before=2C I suggest doing so=2C before looking at this document.
= =0A=

I think the document already has step by step instructi= ons.
I
=0A=
=0A=
=0A= =0A=
=0A= CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individ= ual or entity to which it is addressed and may contain information that is = confidential=2C privileged and exempt from disclosure under applicable law.= If the reader of this message is not the intended recipient=2C you are her= eby notified that any printing=2C copying=2C dissemination=2C distribution= =2C disclosure or forwarding of this communication is strictly prohibited. = If you have received this communication in error=2C please contact the send= er immediately and delete it from your system. Thank You.
= --_7d718dc8-c2a6-47da-8cf5-5324f51b2892_--