Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 856596731 for ; Mon, 20 Jun 2011 22:58:08 +0000 (UTC) Received: (qmail 900 invoked by uid 500); 20 Jun 2011 22:58:08 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 874 invoked by uid 500); 20 Jun 2011 22:58:08 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 865 invoked by uid 99); 20 Jun 2011 22:58:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Jun 2011 22:58:08 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 20 Jun 2011 22:58:07 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 5B5B642451D for ; Mon, 20 Jun 2011 22:57:47 +0000 (UTC) Date: Mon, 20 Jun 2011 22:57:47 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <998346748.22825.1308610667371.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <141681550.22809.1308610007449.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-2088) Move edits log archiving logic into FSEditLog/JournalManager MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2088: ------------------------------ Component/s: name-node Description: Currently the logic to archive edits logs is File-specific which presents some issues for Ivan's work. Since it relies on inspecting storage directories using NNStorage.inspectStorageDirs, it also misses directories that the image layer considers "failed" which results in edits logs piling up in these kinds of directories. This JIRA is similar to HDFS-2018 but only deals with archival for now. Affects Version/s: Edit log branch (HDFS-1073) Fix Version/s: Edit log branch (HDFS-1073) > Move edits log archiving logic into FSEditLog/JournalManager > ------------------------------------------------------------ > > Key: HDFS-2088 > URL: https://issues.apache.org/jira/browse/HDFS-2088 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: Edit log branch (HDFS-1073) > > > Currently the logic to archive edits logs is File-specific which presents some issues for Ivan's work. Since it relies on inspecting storage directories using NNStorage.inspectStorageDirs, it also misses directories that the image layer considers "failed" which results in edits logs piling up in these kinds of directories. This JIRA is similar to HDFS-2018 but only deals with archival for now. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira