Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E7005DCCE for ; Mon, 29 Oct 2012 08:34:31 +0000 (UTC) Received: (qmail 61346 invoked by uid 500); 29 Oct 2012 08:34:27 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 61208 invoked by uid 500); 29 Oct 2012 08:34:26 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 61194 invoked by uid 99); 29 Oct 2012 08:34:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Oct 2012 08:34:26 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [203.91.198.79] (HELO wipro-blr-mx03.wipro.com) (203.91.198.79) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Oct 2012 08:34:18 +0000 X-AuditID: 0ac9321f-b7f8c6d000005a3a-3d-508e3f73ff3f Received: from BLR-OUT-EDG02.wipro.com ( [203.91.193.32]) (using TLS with cipher AES128-SHA (128/128 bits)) (Client did not present a certificate) by wipro-blr-mx03.wipro.com (Symantec Messaging Gateway) with SMTP id 7E.2D.23098.37F3E805; Mon, 29 Oct 2012 14:03:56 +0530 (IST) Received: from BLR-EC-MBX8.wipro.com (10.208.51.118) by BLR-OUT-EDG02.wipro.com (203.91.193.32) with Microsoft SMTP Server (TLS) id 14.2.318.1; Mon, 29 Oct 2012 14:04:05 +0530 Received: from BLR-EC-MBX7.wipro.com ([169.254.7.138]) by BLR-EC-MBX8.wipro.com ([169.254.8.135]) with mapi id 14.02.0318.001; Mon, 29 Oct 2012 14:03:55 +0530 From: To: Subject: How to do HADOOP RECOVERY ??? Thread-Topic: How to do HADOOP RECOVERY ??? Thread-Index: Ac21sCHn5nGTw0DRQEK4m7sPCjDgkA== Date: Mon, 29 Oct 2012 08:33:55 +0000 Message-ID: <2ADA1B0170E3434DA763D609DCD01EB54DF3D33A@BLR-EC-MBX7.wipro.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.203.33.77] Content-Type: multipart/alternative; boundary="_000_2ADA1B0170E3434DA763D609DCD01EB54DF3D33ABLRECMBX7wiproc_" MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFupnleLIzCtJLcpLzFFi42I5HX1QQbfEvi/AYMdWboueKdNYHBg9JnRt YQxgjGpgtEnMy8svSSxJVUhJLU62VQrPLCjKV3DJLE7OSczMTS1SUshMsVUyUlIoyElMTs1N zSuxVUosKEjNS1Gy41LAADZAZZl5Cql5yfkpmXnptkqewf66FhamlrqGSnYhGakKmXlp+UW5 iSWZ+XkKyfl5JQlXeDLmnL7EVnBZveLE6qXMDYxfFLsYOTkkBEwkrt95xghhi0lcuLeerYuR i0NIYBaTxL8t99ghnM2MEu+a+qGcRYwSjz7/A2thE1CQuHx0PiuILSIgI3F56mmWLkYODmEB NYm3n2sgwtoSN0/eY4Kw9SQefJrNDGKzCKhK7Dy4DczmFfCRmLlxIdhIRqArvp9aA1bPLCAu cevJfCaI6wQkluw5zwxhi0q8fPyPFcJWkDi5YRoLRH2+xL+7p9ggZgpKnJz5BCwuBLSr9cxR lgmMIrOQjJ2FpGUWkhaIuJ7EjalT2CBsbYllC18zQ9i6EjP+HWJBFl/AyL6KUaIcFKW6STlF urkVBsZ6YK5ecn7uJkZg6uA6aSS/g/HQHeVDjEFAr09kluIGRQswnuONDQyI5CiJ8zJ5lgYI CaQDE1J2ampBalF8UWlOavEhRiYOTqkGRoX42r0LY8JUbwY9aOvfpfJ22/q5headzxaLfbVP +jblXeG8d++q+N9uXOp+5+Ekm8DKc5pGguc9V24O/9UvXMrZ7bMkuprjou7SR5mG9+5kNkpv CojjkygpnuQ767PW7k3/930Jen36xe4ibeZpy1psC8X3TWbzF7Feq7HAaPGPH3O79fYe6lNi Kc5INNRiLipOBAAxdMnnIgMAAA== X-Virus-Checked: Checked by ClamAV on apache.org --_000_2ADA1B0170E3434DA763D609DCD01EB54DF3D33ABLRECMBX7wiproc_ Content-Type: text/plain; charset="iso-8859-1" content-transfer-encoding: quoted-printable Hi All, I run this command hadoop fsck -Ddfs.http.address=3Dlocalhost:50070 / and found that some blocks are missing and corrupted results comes like.. /user/hive/warehouse/tt_report_htcount/000000_0: MISSING 2 blocks of total s= ize 71826120 B.. /user/hive/warehouse/tt_report_perhour_hit/000000_0: CORRUPT block blk_75438= 572351073797 /user/hive/warehouse/tt_report_perhour_hit/000000_0: MISSING 1 blocks of tot= al size 1531 B.. /user/hive/warehouse/vw_cc/000000_0: CORRUPT block blk_-1280621588594166706 /user/hive/warehouse/vw_cc/000000_0: MISSING 1 blocks of total size 1774 B.. /user/hive/warehouse/vw_report2/000000_0: CORRUPT block blk_8637186139854977= 656 /user/hive/warehouse/vw_report2/000000_0: CORRUPT block blk_4019541597438638= 886 /user/hive/warehouse/vw_report2/000000_0: MISSING 2 blocks of total size 718= 26120 B.. /user/zoo/foo.har/_index: CORRUPT block blk_3404803591387558276 . . . . . Total size: 7600625746 B Total dirs: 205 Total files: 173 Total blocks (validated): 270 (avg. block size 28150465 B) ******************************** CORRUPT FILES: 171 MISSING BLOCKS: 269 MISSING SIZE: 7600625742 B CORRUPT BLOCKS: 269 ******************************** Minimally replicated blocks: 1 (0.37037036 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 0 (0.0 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 1 Average block replication: 0.0037037036 Corrupt blocks: 269 Missing replicas: 0 (0.0 %) Number of data-nodes: 1 Number of racks: 1 Is there any way to recover them ? Please help and suggest Thanks & Regards yogesh kumar The information contained in this electronic message and any attachments to= this message are intended for the exclusive use of the addressee(s) and may= contain proprietary, confidential or privileged information. If you are not= the intended recipient, you should not disseminate, distribute or copy this= e-mail. Please notify the sender immediately and destroy all copies of this= message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should= check this email and any attachments for the presence of viruses. The compa= ny accepts no liability for any damage caused by any virus transmitted by th= is email. www.wipro.com --_000_2ADA1B0170E3434DA763D609DCD01EB54DF3D33ABLRECMBX7wiproc_ Content-Type: text/html; charset="iso-8859-1" content-transfer-encoding: quoted-printable
Hi All,

I run this command

hadoop fsck -Ddfs.http.address=3Dlocalhos= t:50070 /

and found that some blocks are missing and corrupted

results comes like..

/user/hive/warehouse/tt_report_htcount/000000_0: MISSING 2 blocks of total s= ize 71826120 B..
/user/hive/warehouse/tt_report_perhour_hit/000000_0: CORRUPT block blk_75438= 572351073797

/user/hive/warehouse/tt_report_perhour_hit/000000_0: MISSING 1 blocks of tot= al size 1531 B..
/user/hive/warehouse/vw_cc/000000_0: CORRUPT block blk_-1280621588594166706<= br>
/user/hive/warehouse/vw_cc/000000_0: MISSING 1 blocks of total size 1774 B..=
/user/hive/warehouse/vw_report2/000000_0: CORRUPT block blk_8637186139854977= 656

/user/hive/warehouse/vw_report2/000000_0: CORRUPT block blk_4019541597438638= 886

/user/hive/warehouse/vw_report2/000000_0: MISSING 2 blocks of total size 718= 26120 B..
/user/zoo/foo.har/_index: CORRUPT block blk_3404803591387558276
.
.
.
.
.

Total size:    7600625746 B
 Total dirs:    205
 Total files:    173
 Total blocks (validated):    270 (avg. block size 28150= 465 B)
  ********************************
  CORRUPT FILES:    171
  MISSING BLOCKS:    269
  MISSING SIZE:        7600625742 B
  CORRUPT BLOCKS:     269
  ********************************
 Minimally replicated blocks:    1 (0.37037036 %)
 Over-replicated blocks:    0 (0.0 %)
 Under-replicated blocks:    0 (0.0 %)
 Mis-replicated blocks:        0 (0.0 %)<= br>  Default replication factor:    1
 Average block replication:    0.0037037036
 Corrupt blocks:        269
 Missing replicas:        0 (0.0 %)
 Number of data-nodes:        1
 Number of racks:        1




Is there any way to recover them ?=

Please help and suggest

Thanks & Regards
yogesh kumar

The information contained in this electronic message and any attachments= to this message are intended for the exclusive use of the addressee(s) and= may contain proprietary, confidential or privileged information. If you are= not the intended recipient, you should not disseminate, distribute or copy= this e-mail. Please notify the sender immediately and destroy all copies of= this message and any attachments.

WARNING: Computer viruses can be transmitted via email. The recipient sho= uld check this email and any attachments for the presence of viruses. The co= mpany accepts no liability for any damage caused by any virus transmitted by= this email.

www.wipro.com

--_000_2ADA1B0170E3434DA763D609DCD01EB54DF3D33ABLRECMBX7wiproc_--