Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 9125961CC for ; Fri, 24 Jun 2011 22:00:10 +0000 (UTC) Received: (qmail 82100 invoked by uid 500); 24 Jun 2011 22:00:10 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 81713 invoked by uid 500); 24 Jun 2011 22:00:09 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 81657 invoked by uid 99); 24 Jun 2011 22:00:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Jun 2011 22:00:08 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 24 Jun 2011 22:00:07 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id C329C42E2E7 for ; Fri, 24 Jun 2011 21:59:47 +0000 (UTC) Date: Fri, 24 Jun 2011 21:59:47 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <626594405.38673.1308952787795.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2362369.13352.1308266867546.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Resolved] (HDFS-2078) 1073: NN should not clear storage directory when restoring removed storage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2078. ------------------------------- Resolution: Fixed Hadoop Flags: [Reviewed] Committed to branch, thanks for reviewing, Eli. > 1073: NN should not clear storage directory when restoring removed storage > -------------------------------------------------------------------------- > > Key: HDFS-2078 > URL: https://issues.apache.org/jira/browse/HDFS-2078 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: Edit log branch (HDFS-1073) > > Attachments: hdfs-2078.txt, hdfs-2078.txt > > > This JIRA is to address the following scenario/bug: > - The NN is configured with an edits-only storage dir in /edits and an image-only storage dir in /image > - The image dir fails while it is running. Since the edits dir is still valid it does not immediately shut itself down. 2NN continues to try to checkpoint, but fails because it can't upload an image anywhere > - Operator fixes the disk on /image and instructs the NN to restore removed storage > - The 2NN should now be able to download/upload a checkpoint successfully. > Currently this does not work since the NN clears the storage dir upon restoring it. With the 1073 design, out-of-date files aren't a problem, and in fact can be used to restore the namespace. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira