hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Collins (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2016) 1073: remove/archive unneeded/old storage files
Date Wed, 01 Jun 2011 01:27:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041927#comment-13041927

Eli Collins commented on HDFS-2016:

Minor comments follow, otherwise looks great.

* IMO it would be more clear to call archiveOldStorage explicitly from the NN (saveFSImage..)
and 2NN (saveDigestAndRename..)  paths instead of having this run as a side-effect of renameCheckpoint
(which doesn't seem directly related).
* inspectStorageDirs could use a javadoc
* The javadoc for getImageTxIdToRetain needs to be finished
* Would rename retain.checkpoints.count something like num.checkpoints.retained

> 1073: remove/archive unneeded/old storage files
> -----------------------------------------------
>                 Key: HDFS-2016
>                 URL: https://issues.apache.org/jira/browse/HDFS-2016
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Edit log branch (HDFS-1073)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: Edit log branch (HDFS-1073)
>         Attachments: hdfs-2016.txt
> This JIRA is for the infrastructure that periodically scans the storage directories for
files that are no longer necessary and "archives" them. The default archival is just to delete
them, but we may implement something fancier in the future (eg move to SAN or HDFS)

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message