Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D9BCD66C9 for ; Wed, 22 Jun 2011 16:55:08 +0000 (UTC) Received: (qmail 60361 invoked by uid 500); 22 Jun 2011 16:55:08 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 60216 invoked by uid 500); 22 Jun 2011 16:55:08 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 60208 invoked by uid 99); 22 Jun 2011 16:55:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jun 2011 16:55:08 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jun 2011 16:55:07 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 8420342948A for ; Wed, 22 Jun 2011 16:54:47 +0000 (UTC) Date: Wed, 22 Jun 2011 16:54:47 +0000 (UTC) From: "Eli Collins (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <250366818.29839.1308761687537.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <2362369.13352.1308266867546.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-2078) 1073: NN should not clear storage directory when restoring removed storage MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053342#comment-13053342 ] Eli Collins commented on HDFS-2078: ----------------------------------- +1 lgtm > 1073: NN should not clear storage directory when restoring removed storage > -------------------------------------------------------------------------- > > Key: HDFS-2078 > URL: https://issues.apache.org/jira/browse/HDFS-2078 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Fix For: Edit log branch (HDFS-1073) > > Attachments: hdfs-2078.txt, hdfs-2078.txt > > > This JIRA is to address the following scenario/bug: > - The NN is configured with an edits-only storage dir in /edits and an image-only storage dir in /image > - The image dir fails while it is running. Since the edits dir is still valid it does not immediately shut itself down. 2NN continues to try to checkpoint, but fails because it can't upload an image anywhere > - Operator fixes the disk on /image and instructs the NN to restore removed storage > - The 2NN should now be able to download/upload a checkpoint successfully. > Currently this does not work since the NN clears the storage dir upon restoring it. With the 1073 design, out-of-date files aren't a problem, and in fact can be used to restore the namespace. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira