hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matteo Bertozzi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11119) Update ExportSnapShot to optionally not use a tmp file on external file system
Date Sat, 10 May 2014 22:11:18 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992887#comment-13992887

Matteo Bertozzi commented on HBASE-11119:

+1 patch looks good to me, it applies cleanly to 96, 98 and trunk and almost cleanly to 94.
I'll fix the long lines problem on commit.

(ok to have a -Dsnapshot.export.skip.tmp=true instead of a -skip-tmp because you must know
what you are doing. This may speedup a bit where the rename operation is slow but you have
to manually handle the in-progress or failure case, since for the tools the snapshot will
be available as soon as the manifest is copied)

> Update ExportSnapShot to optionally not use a tmp file on external file system
> ------------------------------------------------------------------------------
>                 Key: HBASE-11119
>                 URL: https://issues.apache.org/jira/browse/HBASE-11119
>             Project: HBase
>          Issue Type: Improvement
>          Components: snapshots
>            Reporter: Ted Malaska
>            Assignee: Ted Malaska
>            Priority: Minor
>             Fix For: 0.99.0, 0.96.3, 0.94.20, 0.98.3
>         Attachments: HBASE-11119.patch
> There are FileSystem like S3 where renaming is extremely expensive.  This patch will
add a parameter that says something like
> use.tmp.folder
> It will be defaulted to true.  So default behavior is the same.  If false is set them
the files will land in the final destination with no need for a rename. 

This message was sent by Atlassian JIRA

View raw message