hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HDFS-3956) QJM: purge temporary files when no longer within retention period
Date Wed, 19 Sep 2012 23:45:07 GMT

     [ https://issues.apache.org/jira/browse/HDFS-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Todd Lipcon resolved HDFS-3956.

       Resolution: Fixed
    Fix Version/s: QuorumJournalManager (HDFS-3077)
     Hadoop Flags: Reviewed

Committed to branch, thanks Eli.
> QJM: purge temporary files when no longer within retention period
> -----------------------------------------------------------------
>                 Key: HDFS-3956
>                 URL: https://issues.apache.org/jira/browse/HDFS-3956
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha
>    Affects Versions: QuorumJournalManager (HDFS-3077)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Minor
>             Fix For: QuorumJournalManager (HDFS-3077)
>         Attachments: hdfs-3956.txt
> After doing a bunch of fault testing, I noticed that the JNs had a bunch of temporary
files left around in their journal directories which were no longer within the retention period.
For example, if a JN crashes in the middle of recovery, it can leave around a file like {{edits_inprogress_123.epoch=10}}.
These files are handy to keep around for forensics/debugging while they are still in their
retention period, but we should not leave them forever. The normal purging policy should apply.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message