Return-Path: X-Original-To: apmail-hbase-issues-archive@www.apache.org Delivered-To: apmail-hbase-issues-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E8C566B08 for ; Fri, 8 Jul 2011 20:46:45 +0000 (UTC) Received: (qmail 15789 invoked by uid 500); 8 Jul 2011 20:46:45 -0000 Delivered-To: apmail-hbase-issues-archive@hbase.apache.org Received: (qmail 15475 invoked by uid 500); 8 Jul 2011 20:46:44 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 15458 invoked by uid 99); 8 Jul 2011 20:46:44 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jul 2011 20:46:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 08 Jul 2011 20:46:38 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id CFEEB4EE47 for ; Fri, 8 Jul 2011 20:46:16 +0000 (UTC) Date: Fri, 8 Jul 2011 20:46:16 +0000 (UTC) From: "stack (JIRA)" To: issues@hbase.apache.org Message-ID: <748306494.12359.1310157976848.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1669812681.550.1309677982495.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HBASE-4058) Extend TestHBaseFsck with a complete .META. recovery scenario MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HBASE-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13062170#comment-13062170 ] stack commented on HBASE-4058: ------------------------------ So, reading Wayne's blow-by-blow, he 'fix' his hdfs, he ran 'fsck -move' which moves corrupt files to /lost+found. I wonder how many of the 65 corrupt files found were from hbase and how many of these were from under .META. (65 corrupt files and 173 missing blocks.... thats a lot of 'missing' data). Assuming an extreme, that there missing blocks in .META., this would imply we need to be able to rebuild .META. by reading the filesystem content. It should be able to figure whats a daughter from whats a parent and it should write the .META. without overlaps and with holes plugged. Finally it should make some sort of report on the type of surgery effected listing put-aside regions that it could not make sense of. We currently don't have such a tool. > Extend TestHBaseFsck with a complete .META. recovery scenario > ------------------------------------------------------------- > > Key: HBASE-4058 > URL: https://issues.apache.org/jira/browse/HBASE-4058 > Project: HBase > Issue Type: Improvement > Reporter: Andrew Purtell > Assignee: Andrew Purtell > Fix For: 0.92.0 > > > We should have a unit test that launches a minicluster and constructs a few tables, then deletes META files on disk, then bounces the master, then recovers the result with HBCK. Perhaps it is possible to extend TestHBaseFsck to do this. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira