Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BB19B10DF1 for ; Mon, 3 Feb 2014 21:33:28 +0000 (UTC) Received: (qmail 17056 invoked by uid 500); 3 Feb 2014 21:33:20 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 16943 invoked by uid 500); 3 Feb 2014 21:33:20 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 16932 invoked by uid 99); 3 Feb 2014 21:33:19 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Feb 2014 21:33:19 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of itretyakov@griddynamics.com designates 209.85.217.174 as permitted sender) Received: from [209.85.217.174] (HELO mail-lb0-f174.google.com) (209.85.217.174) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Feb 2014 21:33:15 +0000 Received: by mail-lb0-f174.google.com with SMTP id l4so5777709lbv.19 for ; Mon, 03 Feb 2014 13:32:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=griddynamics.com; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=swWjLqje6zBISFNuD8lfXmkSvvZ5vpYzl8UrxIx2qHQ=; b=ZU3MXDLd0mEd4yb2koBL7RA6Xn6scbAsuOIVJ8azXxm4WvDfTPBykGHGRTMpWoJ+ql Qirq/f0IWpAjdB5dXyNTKvl+zJ4YjsZI0YXHipVVPxbuytY2d6yHJz+Ejy9VrxlMjPr6 aYNwUckezSiHTh2Gv1qIJIC0S2MYTprOv+4vY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=swWjLqje6zBISFNuD8lfXmkSvvZ5vpYzl8UrxIx2qHQ=; b=Lf7FgfHRrsclSdJ60yue9ywLnjJbkWFaqj6s4mfzzyVYJJytOujF6Sijn8NkY0raDM g0R8XWe0VdnUJbsWbpXHJCkQmIAho9dXEgPNb58mZJWtPaYpf34la9uJhN430kYrSVt0 ER/0WFibttR4obEWAq+CnXxFdJAeBdfMBuUGuv3LANSccLaM4/67U1498GJnav4O+IMg 1AbewMV3wJFNzrqftIVjKLouMp3iSys5OntrH6IUpUZP/hASOIPR56tV0s4UOY1WXbbd h8fCsMemCXwTIP0eQOrEBNK+XFMAJY0Sk8WZCojZ49zanMX/OHmtClHYd6UqPC10QjAI 7eIw== X-Gm-Message-State: ALoCoQm+ASrzlo5ELCRmB4Wyy6hhjeARpL9mNDCiFm41td2mQXk7pqFvQGAJk/V6oUS9OxNqmwt1 X-Received: by 10.152.22.1 with SMTP id z1mr3122827lae.39.1391463173502; Mon, 03 Feb 2014 13:32:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.114.196.133 with HTTP; Mon, 3 Feb 2014 13:32:33 -0800 (PST) In-Reply-To: References: From: Ivan Tretyakov Date: Tue, 4 Feb 2014 01:32:33 +0400 Message-ID: Subject: Re: Backup NameNode metadata in HA configuration To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=089e0158b9382ccfba04f187440c X-Virus-Checked: Checked by ClamAV on apache.org --089e0158b9382ccfba04f187440c Content-Type: text/plain; charset=ISO-8859-1 Does anybody can comment 'copying NN metadata directory' vs 'hdfs dfsadmin -fetch', using NN HA configuration? On Fri, Jan 31, 2014 at 8:26 PM, Ivan Tretyakov wrote: > Hi! > > We are using following version of Hadoop software: 2.0.0-cdh4.1.1. > > HDFS HA configuration is applied. > > I would like to ask if there are any difference or possible side effects > of backing up namenode data directory. > > It is ok to just copy NN data directory from active NN to another host, > what about standby NN? > Or it may NN metadate can be in inconsistent state? > Is there any advantages of using "hdfs dfsadmin -fetch " command? > > -- > Best Regards > Ivan Tretyakov > > Deployment Engineer > Grid Dynamics > +7 812 640 38 76 > Skype: ivan.v.tretyakov > www.griddynamics.com > itretyakov@griddynamics.com > -- Best Regards Ivan Tretyakov Deployment Engineer Grid Dynamics +7 812 640 38 76 Skype: ivan.v.tretyakov www.griddynamics.com itretyakov@griddynamics.com --089e0158b9382ccfba04f187440c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Does anybody can comment 'copying NN metadata director= y' vs 'hdfs dfsadmin -fetch', using NN HA configuration?


On Fri, Ja= n 31, 2014 at 8:26 PM, Ivan Tretyakov <itretyakov@griddynamics.c= om> wrote:
Hi!

= We are using following version of Hadoop software: 2.0.0-cdh4.1.1.

<= /div>
HDFS HA configuration is applied.

I would like to as= k if there are any difference or possible side effects of backing up nameno= de data directory.

It is ok to just copy NN data directory from active NN to an= other host, what about standby NN?
Or it may NN metadate can be in inco= nsistent state?
Is there any advantages of using "hdfs d= fsadmin -fetch <file>" command?

--
Best Regards
Ivan Tretyak= ov

Deployment=A0Engineer
Grid Dynamics
+7 812 640 38 76
Skype: ivan.v.tretyakov



--
B= est Regards
Ivan Tretyakov

Deployment=A0= Engineer
Grid Dynamics
+7 812 640 38 76
Skype= : ivan.v.tretyakov
--089e0158b9382ccfba04f187440c--