Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 42D246BCB for ; Tue, 31 May 2011 00:33:30 +0000 (UTC) Received: (qmail 19942 invoked by uid 500); 31 May 2011 00:33:30 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 19914 invoked by uid 500); 31 May 2011 00:33:30 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 19906 invoked by uid 99); 31 May 2011 00:33:30 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 May 2011 00:33:30 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 May 2011 00:33:28 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 558BBEA47D for ; Tue, 31 May 2011 00:32:47 +0000 (UTC) Date: Tue, 31 May 2011 00:32:47 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <837075844.54671.1306801967347.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1453635659.54667.1306801847421.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-2016) 1073: remove/archive unneeded/old storage files MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2016: ------------------------------ Attachment: hdfs-2016.txt Here's a basic patch. There are a couple issues still to work out with how this interacts with the 2NN, but the basic structure should be good. > 1073: remove/archive unneeded/old storage files > ----------------------------------------------- > > Key: HDFS-2016 > URL: https://issues.apache.org/jira/browse/HDFS-2016 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: Edit log branch (HDFS-1073) > > Attachments: hdfs-2016.txt > > > This JIRA is for the infrastructure that periodically scans the storage directories for files that are no longer necessary and "archives" them. The default archival is just to delete them, but we may implement something fancier in the future (eg move to SAN or HDFS) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira