hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4523) Fix concat for snapshots
Date Sat, 23 Feb 2013 01:40:12 GMT
Tsz Wo (Nicholas), SZE created HDFS-4523:
--------------------------------------------

             Summary: Fix concat for snapshots
                 Key: HDFS-4523
                 URL: https://issues.apache.org/jira/browse/HDFS-4523
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: namenode
            Reporter: Tsz Wo (Nicholas), SZE
            Assignee: Tsz Wo (Nicholas), SZE


The use case of concat is for copying large files across clusters using the following steps.
- Step 1: The blocks of a file in the source cluster are copied in parallel to transient files
in the destination cluster.
- Step 2: Then the transient files in the destination cluster are concatenated in order to
obtain the original file.

If a snapshot is taken in the destination cluster before Step 2, some transient files may
be captured in the snapshot.  These transient files should be removed in Step 2.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message