hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Elliott Clark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12325) Add Utility to remove snapshot from a directory
Date Thu, 23 Oct 2014 15:53:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181489#comment-14181489

Elliott Clark commented on HBASE-12325:

bq.The initial design was exporting from one hbase cluster to another,
Export to HDFS has been there for a long time now. What the initial design was doesn't matter
much. It's all about what's useful now.

bq.anyway, you are using export in a wrong way 
Disagree.  This is an easy way to get differential backups that are easily importable and
clean up is pretty easy. If HDFS ever gets hard links then this can go away. But that doesn't
look like it will ever happen.

So users can get differential backups right now. By
# Export all of your snapshots into the same directory on a remote HDFS.
# Keep N snapshots removing the oldest after each export.
# That's it. There are no other steps required.

bq....or, you can use the tool. but the tool requires coordination.

I'm working on a tool that doesn't require any coordination. It just removes the files from
the oldest snapshot that are not referenced any more. So as long as the oldest snapshot is
not still in transition (pretty easy if you're keeping more than 2 snapshots). Then you can
run clean up and snapshot in parallel.

bq.in my opinion this tool doesn't belong to hbase-core
Users of HBase can benefit from a way of doing differential backups. Right now this is the
best way to do that.

> Add Utility to remove snapshot from a directory
> -----------------------------------------------
>                 Key: HBASE-12325
>                 URL: https://issues.apache.org/jira/browse/HBASE-12325
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>         Attachments: DeleteRemoteSnapshotTool.java
> If there are several snapshots exported to a single directory, it's nice to be able to
remove the oldest one. Since snapshots in the same directory can share files it's not as simple
as just removing all files in a snapshot.

This message was sent by Atlassian JIRA

View raw message