hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-14141) HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits from backup tables
Date Tue, 04 Apr 2017 22:26:42 GMT

    [ https://issues.apache.org/jira/browse/HBASE-14141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15955979#comment-15955979
] 

Ted Yu commented on HBASE-14141:
--------------------------------

See if failed tests pass locally.

If they do, submit for another QA run.

> HBase Backup/Restore Phase 3: Filter WALs on backup to include only edits from backup
tables
> --------------------------------------------------------------------------------------------
>
>                 Key: HBASE-14141
>                 URL: https://issues.apache.org/jira/browse/HBASE-14141
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>            Priority: Blocker
>              Labels: backup
>             Fix For: 2.0.0
>
>         Attachments: HBASE-14141.HBASE-14123.v1.patch, HBASE-14141.v1.patch, HBASE-14141.v2.patch,
HBASE-14141.v4.patch, HBASE-14141.v5.patch, HBASE-14141.v6.patch
>
>
> h2. High level design overview
> * When incremental backup request comes for tables {t} we select all the tables already
registered in a backup system  - {T} and union them with {t}, which results in a new table
set - U(t, T)
> * For every table K from U(t,T) we perform the following:
> ** Convert new WAL files into HFile applying table filter K (only edits for table T will
pass the filter)
> ** Move these HFile(s) to backup destination
> During restore (incremental):
> * We run full restore first
> * Then collect all HFiles from intermediate incremental images and run them through HFileSplitterJob,
which splits files into a current tables region boundaries
> * Load these files using LoadIncrementalHFiles tool
>   



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message