Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 81F404297 for ; Thu, 23 Jun 2011 23:13:09 +0000 (UTC) Received: (qmail 86875 invoked by uid 500); 23 Jun 2011 23:13:08 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 86804 invoked by uid 500); 23 Jun 2011 23:13:08 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 86717 invoked by uid 99); 23 Jun 2011 23:13:08 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jun 2011 23:13:08 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Jun 2011 23:13:07 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id A504242C1FE for ; Thu, 23 Jun 2011 23:12:47 +0000 (UTC) Date: Thu, 23 Jun 2011 23:12:47 +0000 (UTC) From: "Todd Lipcon (JIRA)" To: hdfs-dev@hadoop.apache.org Message-ID: <1328361140.34928.1308870767672.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1624816643.64474.1307054867486.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Resolved] (HDFS-2026) 1073: 2NN needs to handle case of reformatted NN better MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2026. ------------------------------- Resolution: Fixed Hadoop Flags: [Reviewed] Committed to branch and opened HDFS-2104 for the -format command. > 1073: 2NN needs to handle case of reformatted NN better > ------------------------------------------------------- > > Key: HDFS-2026 > URL: https://issues.apache.org/jira/browse/HDFS-2026 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: name-node > Affects Versions: Edit log branch (HDFS-1073) > Reporter: Todd Lipcon > Assignee: Todd Lipcon > Priority: Critical > Fix For: Edit log branch (HDFS-1073) > > Attachments: hdfs-2026.txt, hdfs-2026.txt > > > Currently in the 1073 branch, the following steps ends up with a very confused 2NN: > - format NN, run NN > - start 2NN, perform some checkpoints > - reformat NN, start NN on new namespace > - restart same 2NN > The 2NN currently saves the new VERSION info into its local storage directory but doesn't clear out the old checkpoint or edits files. This is obviously wrong and might lead to a corrupt checkpoint getting uploaded. > If the 2NN has storage directories with VERSION info, and connects to an NN with different VERSION info, there are two alternatives: > a) refuse to perform any checkpoints until the operator issues a "secondarynamenode -format" command (this is similar to how the backupnode/checkpointnode works) > b) clear the current contents of the storage directory and save the new NN's VERSION info. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira