Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 170A910E05 for ; Thu, 2 May 2013 13:20:44 +0000 (UTC) Received: (qmail 91193 invoked by uid 500); 2 May 2013 13:20:39 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 90801 invoked by uid 500); 2 May 2013 13:20:38 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 90731 invoked by uid 99); 2 May 2013 13:20:38 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 May 2013 13:20:37 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates 209.85.210.180 as permitted sender) Received: from [209.85.210.180] (HELO mail-ia0-f180.google.com) (209.85.210.180) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 May 2013 13:20:32 +0000 Received: by mail-ia0-f180.google.com with SMTP id 21so166949iay.25 for ; Thu, 02 May 2013 06:20:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type:x-gm-message-state; bh=MSykaRtUfC7MP3s4AulsIMcbWRG7ongAlYhXmYc+BKo=; b=ayiW1E8gXSUIMwr1dR8fk+UcpguTB2eKSjGzxAh8qDxhStES4Ugz2IsAPzLLwzcVbE XSRMMZCxp45sSYGlpLl9PYhG96/mf7HMgh46hxwPDxqi3gApDaoBoccvvrcuVzMrlnlG nqj7TYMlMN00/sea4MzxXE1Z4QYmpTZhN3TEv2tqasKzUiHZ7LVNu+Ona46z4+t6pYoR NHEy3zWgbR813dcmF1wmno51sirqP+HioMD1c2gSume5fZ8z3C5g19MajBd6gvkF6HGn qWU/qaE5Hya4xO7hJTKJj0wphQ9QatZyCESjL3XiF9Kd/atAXuYIUALLyPEge07OaVox AiqA== X-Received: by 10.42.64.135 with SMTP id g7mr3242333ici.37.1367500811662; Thu, 02 May 2013 06:20:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.101.77 with HTTP; Thu, 2 May 2013 06:19:51 -0700 (PDT) In-Reply-To: <518261E7.8020606@doopai.com> References: <518261E7.8020606@doopai.com> From: Harsh J Date: Thu, 2 May 2013 18:49:51 +0530 Message-ID: Subject: Re: How to restore HDFS data To: "" Content-Type: multipart/alternative; boundary=90e6ba5bbaa31c09eb04dbbc18c0 X-Gm-Message-State: ALoCoQlPXZP8/gulVRHPq5hCsh6/b2d2RbSTAKySF5kPhxhT2SdT2WHCj9Hr10HporMuwiVKhmeD X-Virus-Checked: Checked by ClamAV on apache.org --90e6ba5bbaa31c09eb04dbbc18c0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable If you've already run -delete (-move is a better choice if you know DN fault is temporary), then the missing blocks are already deleted from the namespace permanently. No way to recover the data since the blocks have also been invalidated by now. A HDFS Snapshots feature will arrive in near future to cover the backup scenarios that may prove useful in cases such as this. On Thu, May 2, 2013 at 6:23 PM, =E6=AE=B5=E6=B4=AA=E4=B9=89 wrote: > Datanode error, and then I run hadoop fsck /-delete.Lost a lot of data, > Later, these datanode recovery, Is there any way to restore the fsck > command to delete the data. > --=20 Harsh J --90e6ba5bbaa31c09eb04dbbc18c0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
If you've already run -delete (-move is a better choic= e if you know DN fault is temporary), then the missing blocks are already d= eleted from the namespace permanently. No way to recover the data since the= blocks have also been invalidated by now.

A HDFS Snapshots feature will arrive in near future to= cover the backup scenarios that may prove useful in cases such as this.


On T= hu, May 2, 2013 at 6:23 PM, =E6=AE=B5=E6=B4=AA=E4=B9=89 &= lt;duanhongyi@do= opai.com> wrote:
Datanode error, and then I run hadoop fsck /= -delete.Lost a lot of data,
Later, these datanode recovery, Is there any way to restore the fsck
command to delete the data.



--
Harsh J
--90e6ba5bbaa31c09eb04dbbc18c0--