hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-4058) Extend TestHBaseFsck with a complete .META. recovery scenario
Date Fri, 08 Jul 2011 20:46:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13062170#comment-13062170
] 

stack commented on HBASE-4058:
------------------------------

So, reading Wayne's blow-by-blow, he 'fix' his hdfs, he ran 'fsck -move' which moves corrupt
files to /lost+found.  I wonder how many of the 65 corrupt files found were from hbase and
how many of these were from under .META. (65 corrupt files and 173 missing blocks.... thats
a lot of 'missing' data).  Assuming an extreme, that there missing blocks in .META., this
would imply we need to be able to rebuild .META. by reading the filesystem content.  It should
be able to figure whats a daughter from whats a parent and it should write the .META. without
overlaps and with holes plugged.  Finally it should make some sort of report on the type of
surgery effected listing put-aside regions that it could not make sense of.

We currently don't have such a tool.

> Extend TestHBaseFsck with a complete .META. recovery scenario
> -------------------------------------------------------------
>
>                 Key: HBASE-4058
>                 URL: https://issues.apache.org/jira/browse/HBASE-4058
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>             Fix For: 0.92.0
>
>
> We should have a unit test that launches a minicluster and constructs a few tables, then
deletes META files on disk, then bounces the master, then recovers the result with HBCK. Perhaps
it is possible to extend TestHBaseFsck to do this.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message