hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "rajeshbabu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-8348) Polish the migration to 0.96
Date Wed, 14 Aug 2013 10:14:51 GMT

     [ https://issues.apache.org/jira/browse/HBASE-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

rajeshbabu updated HBASE-8348:

    Attachment: HBASE-8348_trunk_v3.patch

Here is the patch includes migrations script
Migration steps include:
1) running NamespaceUpgrade tool - migrates hdfs data    
2) running ZK data migrator tool - migrates zookeeper data. current patch migrating replication
znodes as well.
3) removing hbase.id (to avoid HBASE-9177)
4) running HFileV1Detector tool - to identify v1 hfiles.

Tested the patch in the cluster
1) installed two clusters with 0.94.11 version hbase. Enabled replication.
i) master cluster ii) slave cluster
2) created table with replication scope 1 and done some puts and deletes. replication in progress
3) stopped two clusters.
4) ran migrate script
5) restarted two clusters with 0.96.0 version hbase.
6) done some puts and replication also happening as usual. Everything fine.

TODO: We can use replication backup tool once its ready

> Polish the migration to 0.96
> ----------------------------
>                 Key: HBASE-8348
>                 URL: https://issues.apache.org/jira/browse/HBASE-8348
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.95.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: rajeshbabu
>            Priority: Critical
>             Fix For: 0.95.2
>         Attachments: HBASE-8348_trunk.patch, HBASE-8348_trunk_v2.patch, HBASE-8348_trunk_v3.patch
> Currently, migration works but there's still a couple of rough edges:
>  - HBASE-8045 finished the .META. migration but didn't remove ROOT, so it's still on
the filesystem.
>  - Data in ZK needs to be removed manually. Either we fix up the data in ZK or we delete
it ourselves.
>  - TestMetaMigrationRemovingHTD has a testMetaUpdatedFlagInROOT method, but ROOT is gone
> Elliott was also mentioning that we could have "hbase migrate" do the HFileV1 checks,
clear ZK, remove ROOT, etc.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message