hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Rodionov <vladrodio...@gmail.com>
Subject Re: [VOTE] Backup/Restore feature for HBase 2.0, vote closing 3/11/2017
Date Fri, 10 Mar 2017 07:27:54 GMT
bump

On Thu, Mar 9, 2017 at 10:11 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> +1 from me as well.
>
> On Wed, Mar 8, 2017 at 3:48 PM, Enis Söztutar <enis@apache.org> wrote:
>
> > Thanks Vladimir for the write up and the work. Glad to see progress.
> >
> > Here is my +1. I'm pretty sure we can get the blockers in before the 2.0
> > timeframe with the momentum, so it is a good idea to merge now so that
> > development can continue in master, and there is more exposure for
> testing,
> > etc.
> >
> > Enis
> >
> > On Wed, Mar 8, 2017 at 1:32 PM, Vladimir Rodionov <
> vladrodionov@gmail.com>
> > wrote:
> >
> > > Hello, HBase folks
> > >
> > > For your consideration today is Backup/Restore feature for Apache HBAse
> > > 2.0.
> > > Backup code is available as a mega patch in HBASE-14123 (v61), applies
> > > cleanly to the current master, all test PASS, patch has no other
> issues.
> > >
> > > The patch has gone through numerous rounds of code reviews and has
> > probably
> > > the most lengthy discussion thread on Apache JIRA (HBASE-14123) :)
> > >
> > > The work has been split into 3 phases (HBASE-14030, 14123, 14414) Two
> > first
> > > are complete, third one is still in progress.
> > >
> > >
> > > *** Summary of work HBASE-14123
> > >
> > > The new feature introduces new command-line extensions to the hbase
> > command
> > > and, from the client side, is accessible through command-line only
> > > Operations:
> > > * Create full backup on a list of tables or backup set
> > > * Create incremental backup image for table list or backup set
> > > * Restore list of tables from a given backup image
> > > * Show current backup progress
> > > * Delete backup image and all related images
> > > * Show history of backups
> > > * Backup set operations: create backup set, add/remove table to/from
> > backup
> > > set, etc
> > >
> > > In the current implementation, the feature is already usable, meaning
> > that
> > > users can backup tables and restore them using provided command-line
> > tools.
> > > Both: full and incremental backups are supported.
> > > This work is based on original work of IBM team (HBASE-7912). The full
> > list
> > > of JIRAs included in this mega patch can be found in three umbrella
> > JIRAs:
> > > HBASE-14030 (Phase 1), HBASE-14123 (Phase 2) and HBASE-14414 (Phase 3 -
> > all
> > > resolved ones made it into the patch)
> > >
> > > *** What are the remaining work items
> > >
> > > All remaining items can be found in Phase 3 umbrella JIRA: HBASE-14414.
> > > They are split into 3 groups: BLOCKER, CRITICAL, MAJOR
> > > Only BLOCKERs and CRITICALs are guaranteed for HBase 2.0 release.
> > >
> > > ***** BLOCKER
> > >
> > > * HBASE-14417 Incremental backup and bulk loading ( Patch available)
> > > * HBASE-14135 HBase Backup/Restore Phase 3: Merge backup images
> > > * HBASE-14141 HBase Backup/Restore Phase 3: Filter WALs on backup to
> > > include only edits from backup tables (Patch available)
> > > * HBASE-17133 Backup documentation
> > > * HBASE-15227 Fault tolerance support
> > >
> > > ***** CRITICAL
> > >
> > > * HBASE-16465 Disable split/merges during backup
> > >
> > > We have umbrella JIRA (HBASE-14414) to track all the remaining work
> > > All the BLOCKER and CRITICAL JIRAs currently in open state will be
> > > implemented by 2.0 release time. Some MAJOR too, but it depends on
> > resource
> > > availability
> > > The former development branch (HBASE-7912) is obsolete and will be
> > > closed/deleted after the merge.
> > > We want backup to be a GA feature in 2.0
> > > We are going to support full backward compatibility for backup tool in
> > 2.0
> > > and onwards.
> > >
> > > **** Configuration
> > >
> > > Backup is disabled, by default. To enable it, the following
> configuration
> > > properties must be added to hbase-site.xml:
> > >
> > > hbase.backup.enable=true
> > > hbase.master.logcleaner.plugins=YOUR_PLUGINS,org.
> > > apache.hadoop.hbase.backup.master.BackupLogCleaner
> > > hbase.procedure.master.classes=YOUR_CLASSES,org.
> > > apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager
> > > hbase.procedure.regionserver.classes=YOUR_CLASSES,org.
> > > apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureMa
> > > nager
> > >
> > >
> > > I would like to thank IBM team and Jerry He for original work,
> > >
> > > Enis, Ted, Stack, Matteo, Jerry for time spent on code reviews
> > >
> > > Special thanks to Ted Yu for his co-development work.
> > >
> > > References:
> > >
> > > https://issues.apache.org/jira/browse/HBASE-7912 (original IBM,
> contains
> > > design doc)
> > > https://issues.apache.org/jira/browse/HBASE-14030 (Phase 1)
> > > https://issues.apache.org/jira/browse/HBASE-14123 (Phase 2)
> > > https://issues.apache.org/jira/browse/HBASE-14414 (Phase 3)
> > >
> > > Please  vote +1/-1 by midnight Pacific Time (00:00
> > > -0800 GMT) on March 11th  ​on whether or not we should merge this into
> > the
> > > current master.
> > >
> > > -Vladimir Rodionov
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message