hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-14417) Incremental backup and bulk loading
Date Wed, 31 Aug 2016 14:55:20 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449854#comment-15449854
] 

Ted Yu edited comment on HBASE-14417 at 8/31/16 2:55 PM:
---------------------------------------------------------

In backup package, a new class would be added which extends WALActionsListener.Base
It overrides postAppend() where we look for Cell with qualifier of WALEdit.BULK_LOAD.
If found, BulkLoadDescriptor is extracted and StoreDescriptor's can be retrieved.
The store file list would be persisted to hbase:backup table.


was (Author: yuzhihong@gmail.com):
In principal, the above is in line with my earlier comments.

> Incremental backup and bulk loading
> -----------------------------------
>
>                 Key: HBASE-14417
>                 URL: https://issues.apache.org/jira/browse/HBASE-14417
>             Project: HBase
>          Issue Type: New Feature
>    Affects Versions: 2.0.0
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>            Priority: Critical
>              Labels: backup
>             Fix For: 2.0.0
>
>
> Currently, incremental backup is based on WAL files. Bulk data loading bypasses WALs
for obvious reasons, breaking incremental backups. The only way to continue backups after
bulk loading is to create new full backup of a table. This may not be feasible for customers
who do bulk loading regularly (say, every day).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message