hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3637) Support for snapshots
Date Wed, 25 Jun 2008 14:04:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12608046#action_12608046

dhruba borthakur commented on HADOOP-3637:

My understanding is that a data warehousing platform need a huge number of snapshots. It is
typical to create a snapshot on production data and then run a decision-analysis-software
on the snapshot. It has to write summary reports on the snapshots (hence the writebable snapshots).

Creating a snapshots should create a copy of the fsimage and transaction log. For disaster
recovery solutions, we would have to transfer these images/edits to a remote location using
some external software. I will add this to the requirement. Requirement 8 is as follows:

1. Support using snapshots for disaster recovery. Provide an example to transfer fsimage/edits
file for each snapshot to some remote location using an external piece of software (e.g. ftp,
scp, etc). Provide docs to recover HDFS from one of these snapshots.

> Support for snapshots
> ---------------------
>                 Key: HADOOP-3637
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3637
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: dfs
>            Reporter: dhruba borthakur
>            Assignee: dhruba borthakur
> Support HDFS snapshots. It should support creating snapshots without shutting down the
file system. Snapshot creation should be lightweight and a typical system should be able to
support a few thousands concurrent snapshots. There should be a way to surface (i.e. mount)
a few of these snapshots simultaneously.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message