hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vladimir Rodionov (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-17825) Backup: further optimizations
Date Fri, 23 Feb 2018 19:04:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374850#comment-16374850
] 

Vladimir Rodionov edited comment on HBASE-17825 at 2/23/18 7:03 PM:
--------------------------------------------------------------------

{quote}
How does this change output
{quote}

It does not change output, but it changes output directory structure. It used to be flat,
now it adds subdirectories for every table:

If we convert WALs for tables T1, T2, T3 the tool will create separate directories for each
table:

T1/
T2/
T3/

and files for each table go to this table's subdirectory 


was (Author: vrodionov):
{quote}
How does this change output
{quote}

It does not change output, but it changes output directory structure. It used to be flat,
now it adds subdirectories for every table:

If we convert WALs for tables T1, T2, T3 the tool will create separate directories for each
table:

T1/
T2/
T3/

> Backup: further optimizations
> -----------------------------
>
>                 Key: HBASE-17825
>                 URL: https://issues.apache.org/jira/browse/HBASE-17825
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Vladimir Rodionov
>            Assignee: Vladimir Rodionov
>            Priority: Critical
>              Labels: backup
>             Fix For: 3.0.0
>
>         Attachments: HBASE-17825-v1.patch, HBASE-17825-v2.patch, HBASE-17825-v3.patch,
HBASE-17825-v4.patch
>
>
> Some phases of backup and restore can be optimized:
> # WALPlayer support for multiple tables
> # Run DistCp once per all tables during backup/restore
> The eventual goal:
> # 2 M/R jobs per backup/restore



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message