hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912
Date Wed, 20 Jul 2016 16:43:46 GMT
Stack,

This is brief description of phases:

Phase 1 and Phase 2 :

1. Support for full backup of a table, list of tables
2. Support for incremental backup of a table, list of tables
3. Restore table(s) from backup (full or incremental)
4. HBase Backup API - via BackupAdmin
5. Command - line interface to backup / restore
6. Set of command supported: hbase backup create, restore, history, delete,
describe, progress
7. Backup sets (one can create backup set - named collection of tables)
support.

This gives user fully functional backup/restore tool set.

Phase 3 (major ones):
Umbrella HBASE-14414

1. Support for bulk loaded data in incremental backups
2. Security
3. Various performance optimizations during backup/restore
4. Merge of backup images
5. Filter WALs on incremental backup
6. Fault tolerance
7. Multiple backup destinations
8. MultiWAL support

-Vlad




On Wed, Jul 20, 2016 at 9:14 AM, Stack <stack@duboce.net> wrote:

> On Mon, Jul 11, 2016 at 12:21 PM, Enis Söztutar <enis@apache.org> wrote:
>
> > As you guys may already be familiar, Vladimir, Ted, Jerry and others have
> > been developing the backup / restore functionality in a series of issues
> > committed in the separate branch HBASE-7912[1].
> >
> > Backup / Restore functionality is tracked as a 4-phase project, and the
> > first two phases are complete and useable. We are now working on Phase 3
> > items, which are mostly improvements. We think that the current code in
> the
> > branch containing all Phase 1 and Phase 2 items, and some Phase 3 items
> is
> > useable on it's own, and we do not have to wait for all the subtickets to
> > be finished to make it completely useable (as follow up tickets are
> mostly
> > improvements or optimizations). The improvements in the works are all
> > backwards compatible with the existing stuff. Thus, we would like to
> > propose that the branch HBASE-7912 be merged into master.  The parent
> jira
> > has a design doc that goes into details about the implementation and
> design
> > choices in case you are interested[2].
> >
> >
> Thanks Enis.
>
> I could read the design doc but it would be nice to have a succinct summary
> of what we get with phase 1 and phase 2 of this feature, especially here on
> this thread, and then what is coming in phase 3.
>
> Thanks,
> St.Ack
>
>
> > Most of the changes are largely non-intrusive and confined to the
> > backup subsystem.
> > The unit tests have been passing on manual runs and we (hortonworks) have
> > been running the integration tests as well as some other shell-based
> system
> > tests on a forked version of the code. Most of the work has been reviewed
> > by 1, 2 or 3 committers already (mostly Ted, myself and Jerry).
> >
> > What do you guys think? Is it time to call a vote? Any concerns or
> feedback
> > appreciated.
> >
> > [1] https://issues.apache.org/jira/browse/HBASE-7912
> > [2]
> >
> >
> https://issues.apache.org/jira/secure/attachment/12816339/HBaseBackupAndRestore%20-0.91.pdf
> >
> > Enis
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message