hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4523) Fix concat for snapshots
Date Sat, 23 Feb 2013 01:40:12 GMT
Tsz Wo (Nicholas), SZE created HDFS-4523:

             Summary: Fix concat for snapshots
                 Key: HDFS-4523
                 URL: https://issues.apache.org/jira/browse/HDFS-4523
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: namenode
            Reporter: Tsz Wo (Nicholas), SZE
            Assignee: Tsz Wo (Nicholas), SZE

The use case of concat is for copying large files across clusters using the following steps.
- Step 1: The blocks of a file in the source cluster are copied in parallel to transient files
in the destination cluster.
- Step 2: Then the transient files in the destination cluster are concatenated in order to
obtain the original file.

If a snapshot is taken in the destination cluster before Step 2, some transient files may
be captured in the snapshot.  These transient files should be removed in Step 2.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message