Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6FEFF10DDF for ; Wed, 5 Jun 2013 10:24:10 +0000 (UTC) Received: (qmail 36291 invoked by uid 500); 5 Jun 2013 10:24:03 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 36225 invoked by uid 500); 5 Jun 2013 10:24:03 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 36216 invoked by uid 99); 5 Jun 2013 10:24:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Jun 2013 10:24:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of ju.han.felix@gmail.com designates 209.85.128.175 as permitted sender) Received: from [209.85.128.175] (HELO mail-ve0-f175.google.com) (209.85.128.175) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Jun 2013 10:23:54 +0000 Received: by mail-ve0-f175.google.com with SMTP id da11so1081389veb.34 for ; Wed, 05 Jun 2013 03:23:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=fScIpdRUnCd9l+U9+VPKXskOpsFU2b8XGTxY9KZJySs=; b=0hC/iyOx5B+nlnac2+/kugj12uxnBoNZ9cVmT1mezn6HzrYDzbDE1wcmJDK2vdCDJ4 d6vPuhYj1dukUj9hi7mJ0NBOfvbXqGHLNVdtbX7aw+KzXKNQ6zCRmreeRmm1/WcBmfrz pNx1TnogzI+eFx1yfbbFEscgV/0e7XqmZ5F67ozczp2rymGO8nazdjsA8nfxGy91J+Bl JC7fp0r5AYQbMaYMiUl7F5ZMf7kqkzT6VEKNiFrk3ZplVIYsSNIhAgxo+FgPthawiLGu mo12KwG8UDfHu/RnDR6ZM9OIal8Q1GogfbHGoEK3hwpYyKpUQH+VzMAt6n8C2ejY2k3c ZlqA== MIME-Version: 1.0 X-Received: by 10.220.85.204 with SMTP id p12mr20247684vcl.1.1370427814039; Wed, 05 Jun 2013 03:23:34 -0700 (PDT) Received: by 10.59.0.195 with HTTP; Wed, 5 Jun 2013 03:23:33 -0700 (PDT) In-Reply-To: References: Date: Wed, 5 Jun 2013 12:23:33 +0200 Message-ID: Subject: Re: Recover dfs/name From: Han JU To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c1f5320bf32004de65975b X-Virus-Checked: Checked by ClamAV on apache.org --001a11c1f5320bf32004de65975b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Thanks Ted. In fact it's an experimental cluster so no checkpointing... and snn is running in the same machine as nn, so I think its copy of metadata is also deleted by my colleague ... Does this mean that I have no choice but format/start over my HDFS? 2013/6/5 Ted Xu > Hi Han, > > HDFS metadata cannot be fully reconstructed by datanode report. > > If you have deployed a checkpoint node/secondary namenode, you can copy > the metadata to namenode and restart. This could recover most of the > metadata. > > > On Wed, Jun 5, 2013 at 5:30 PM, Han JU wrote: > >> Hi, >> >> The folder /tmp/hadoop-user/dfs/name is accidentally deleted by a >> colleague (along with all other things in this directory), is there any >> means to recover this directory? >> I know the directory where dfs is located in every datanode. Can I >> reconstruct the deleted files without formatting the hdfs? >> >> Thanks! >> >> -- >> *JU Han* >> >> Software Engineer Intern @ KXEN Inc. >> UTC - Universit=E9 de Technologie de Compi=E8gne >> * **GI06 - Fouille de Donn=E9es et D=E9cisionnel* >> >> +33 0619608888 >> > > > > -- > Regards, > Ted Xu > --=20 *JU Han* Software Engineer Intern @ KXEN Inc. UTC - Universit=E9 de Technologie de Compi=E8gne * **GI06 - Fouille de Donn=E9es et D=E9cisionnel* +33 0619608888 --001a11c1f5320bf32004de65975b Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks Ted.
In fact it's an experimental clu= ster so no checkpointing... and snn is running in the same machine as nn, s= o I think its copy of metadata is also deleted by my colleague ...

Does this mean that I have no choice but format/start = over my HDFS?


2013/6/5 Ted Xu <txu@gopivotal.com>
Hi Han,

= HDFS metadata cannot be fully reconstructed by datanode report.=A0

If you have deployed a checkpoint node/secondary namenode, you c= an copy the metadata to namenode and restart. This could recover most of th= e metadata.=A0


On Wed, Jun 5, 2013 at 5:30 PM, Han JU &= lt;ju.han.felix= @gmail.com> wrote:
Hi,

The = folder /tmp/hadoop-user/dfs/name is accidentally deleted by a colleague (al= ong with all other things in this directory), is there any means to recover= this directory?
I know the directory where dfs is located in every datanode. Can I reconstr= uct the deleted files without formatting the hdfs?

Thanks!=A0

--
JU Han<= /b>

= Software Engineer Intern @ KXEN Inc.
UTC=A0=A0 - =A0Universit=E9 de Technologie de Compi=E8gne
=A0=A0=A0=A0 GI06 - Fouille de Donn=E9es et D=E9cisionnel




--
Regards,
Ted Xu



--
JU Han

=
Software E= ngineer Intern @ KXEN Inc.
UTC=A0=A0 - =A0Universit=E9 de Technologie de Compi=E8gne
=A0=A0=A0=A0 GI06 - Fouille de Donn=E9es et D=E9ci= sionnel

+33 0619608888
--001a11c1f5320bf32004de65975b--