hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-1342) Add to filesystem info needed to rebuild .META.
Date Fri, 01 May 2009 22:33:30 GMT

     [ https://issues.apache.org/jira/browse/HBASE-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

stack updated HBASE-1342:

    Attachment: 1342.patch

This patch ups logging on master mostly so region transitions do not log their name only but
now log the whole RegionInfo.  Makes it so the encoded name, start and stop keys are to hand
debugging or when trying to figure sequence of events -- which is the parent and which the
daughter, and which daughter does what part of range.

If the extra logging intrusive, we can dial it down later.

> Add to filesystem info needed to rebuild .META.
> -----------------------------------------------
>                 Key: HBASE-1342
>                 URL: https://issues.apache.org/jira/browse/HBASE-1342
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>             Fix For: 0.20.0
>         Attachments: 1342.patch
> From Cosmin up on list:
> {code}
> Hi,
> Is there any way to rebuild the .META. Table with information in HDFS?
> Long story short, the namenode ran out of disk and crashed and we couldn't
> have it load the edits.new file at startup (the edits.new file seemed
> corrupted and it failed to read some Long value) so we removed the edits.new
> file. Apparently the edits file had 10 - 15 entries. Some edit data on
> -ROOT-, some edit data on .META., some data on a table compaction
> (comapction.dir) and some data on some hbase logs. Only last entry seem to
> be bogus, having almost a megabyte of trailing zeroes.
> After renaming edits.new HDFS started ok and HBase data is present. However
> when we started Hbase one table was missing entirely and one table was
> empty. The HBase master report shows Regions On FS: 94, but the report on
> region servers shows only 10 regions on all the region servers.
> Is there any way to cleanup hbase and rebuild the .META. table from HDFS?
> This would be ok even if it implies throwing up some data.
> If we would clean the edits.new file and restart HDFS or if we would
> manually apply the edits would that still make consistent changes to HBase
> data?
> Thanks,
> Cosmin
> {code}
> Lets log the info needed to rebuild your .META. or add things like HRegionInfo made creating
a region as a file under each region directory.  That don't seem hard and the info could be
used rebuilding.  What else would we need?
> Marking as blocker/critical for 0.20.0.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message