Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E65D96DF for ; Fri, 23 Sep 2011 17:25:17 +0000 (UTC) Received: (qmail 36486 invoked by uid 500); 23 Sep 2011 17:25:14 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 36418 invoked by uid 500); 23 Sep 2011 17:25:14 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 36410 invoked by uid 99); 23 Sep 2011 17:25:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Sep 2011 17:25:14 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Ivan.Novick@emc.com designates 128.222.32.20 as permitted sender) Received: from [128.222.32.20] (HELO mexforward.lss.emc.com) (128.222.32.20) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Sep 2011 17:25:08 +0000 Received: from hop04-l1d11-si04.isus.emc.com (HOP04-L1D11-SI04.isus.emc.com [10.254.111.24]) by mexforward.lss.emc.com (Switch-3.4.3/Switch-3.4.3) with ESMTP id p8NHOje5026395 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 23 Sep 2011 13:24:45 -0400 Received: from mailhub.lss.emc.com (mailhub.lss.emc.com [10.254.222.129]) by hop04-l1d11-si04.isus.emc.com (RSA Interceptor) for ; Fri, 23 Sep 2011 13:24:32 -0400 Received: from mxhub01.corp.emc.com (mxhub01.corp.emc.com [10.254.141.103]) by mailhub.lss.emc.com (Switch-3.4.3/Switch-3.4.3) with ESMTP id p8NHOVHH024173 for ; Fri, 23 Sep 2011 13:24:32 -0400 Received: from mx22a.corp.emc.com ([169.254.1.89]) by mxhub01.corp.emc.com ([10.254.141.103]) with mapi; Fri, 23 Sep 2011 13:24:32 -0400 From: To: Date: Fri, 23 Sep 2011 13:25:55 -0400 Subject: Re: formatting hdfs without user interaction Thread-Topic: formatting hdfs without user interaction Thread-Index: Acx6FafrQdsiysPhRSSYfpIjHY4USQ== Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.0.0.100825 acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-EMM-MHVC: 1 X-Virus-Checked: Checked by ClamAV on apache.org On 9/23/11 9:46 AM, "Harsh J" wrote: >Ivan, > >On Fri, Sep 23, 2011 at 9:22 PM, wrote: >[snip] >> Which parameter are you referring to? I am planning on using 2 >>directories >> in dfs.name.dir, one is local and the other is an NFS mount of a 2nd >> machine running the secondary namenode. > >I'm slightly confused here. Do you mean to say a 'SecondaryNameNode', >which is a form of checkpointing daemon available as part of Hadoop, >or do you mean to say, loosely, 'secondary namenode', which would >imply a machine that can step in as a NameNode once you start it (in >case the primary fails)? > >For the former, the properties are the ones that begin with >"fs.checkpoint.*" in 0.20.x versions, which you can checkout. I mean both... A 2nd node which can step in as a name node and also that node will run the checkpointing daemon. I have 2 directories in dfs.name.dir one is local and one is remote on the 2nd machine so we have a copy of the data if we lose the first machine. Cheers, Ivan