hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tony Wu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster
Date Wed, 28 Oct 2015 01:05:27 GMT

     [ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tony Wu updated HDFS-9308:
--------------------------
    Attachment: HDFS-9308.002.patch

* Add {{truncateMeta()}} and {{deleteMeta()}} method to truncate/delete meta data files on
DataNodes.
* Modify {{TestLeaseRecovery#testBlockRecoveryWithLessMetafile}} to use the new APIs.
* Enhance {{TestLeaseRecovery#testBlockRecoveryWithLessMetafile}} to check the file size after
lease recovery is complete. Truncating the metadata file on DataNodes will effectively reduce
the file size after lease recovery. The test should verify the new file size as well.
* Modify {{TestCrcCorruption#thistest}} to use the new APIs.

> Add truncateMeta() and deleteMeta() to MiniDFSCluster
> -----------------------------------------------------
>
>                 Key: HDFS-9308
>                 URL: https://issues.apache.org/jira/browse/HDFS-9308
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: HDFS, test
>    Affects Versions: 2.7.1
>            Reporter: Tony Wu
>            Assignee: Tony Wu
>            Priority: Minor
>         Attachments: HDFS-9308.001.patch, HDFS-9308.002.patch
>
>
> HDFS-9188 introduced {{corruptMeta()}} method to make corrupting the metadata file filesystem
agnostic. There should also be a {{truncateMeta()}} and {{deleteMeta()}} method in MiniDFSCluster
to allow truncation of metadata files on DataNodes without writing code that's specific to
underling file system. {{FsDatasetTestUtils#truncateMeta()}} is already implemented by HDFS-9188
and cam be exposed easily in {{MiniDFSCluster}}.
> This will be useful for tests such as {{TestLeaseRecovery#testBlockRecoveryWithLessMetafile}}
and {{TestCrcCorruption#testCrcCorruption}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message