hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-2016) 1073: remove/archive unneeded/old storage files
Date Thu, 02 Jun 2011 21:05:47 GMT

    [ https://issues.apache.org/jira/browse/HDFS-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043045#comment-13043045
] 

Todd Lipcon commented on HDFS-2016:
-----------------------------------

Hi Rajiv. No, this is about the image and edits files inside of dfs.name.dir/current/. On
the HDFS-1073 branch (of which this ticket is a part), existing files are not modified or
deleted as checkpoints and log rolls happen. So, without this patch, the current/ directory
will slowly fill up with old files until you're out of disk space :)

> 1073: remove/archive unneeded/old storage files
> -----------------------------------------------
>
>                 Key: HDFS-2016
>                 URL: https://issues.apache.org/jira/browse/HDFS-2016
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: name-node
>    Affects Versions: Edit log branch (HDFS-1073)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: Edit log branch (HDFS-1073)
>
>         Attachments: hdfs-2016.txt
>
>
> This JIRA is for the infrastructure that periodically scans the storage directories for
files that are no longer necessary and "archives" them. The default archival is just to delete
them, but we may implement something fancier in the future (eg move to SAN or HDFS)

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message