Return-Path: Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: (qmail 11046 invoked from network); 4 Dec 2010 00:34:34 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 4 Dec 2010 00:34:34 -0000 Received: (qmail 85500 invoked by uid 500); 4 Dec 2010 00:34:34 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 85395 invoked by uid 500); 4 Dec 2010 00:34:34 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 85387 invoked by uid 99); 4 Dec 2010 00:34:34 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Dec 2010 00:34:34 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 04 Dec 2010 00:34:32 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id oB40YA0f005370 for ; Sat, 4 Dec 2010 00:34:10 GMT Message-ID: <22130539.104461291422850834.JavaMail.jira@thor> Date: Fri, 3 Dec 2010 19:34:10 -0500 (EST) From: "dhruba borthakur (JIRA)" To: hdfs-issues@hadoop.apache.org Subject: [jira] Updated: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command In-Reply-To: <14859332.184291290122595001.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1509: ----------------------------------- Attachment: resyncBadNameDir1.txt Unit test doe snot pass yet, this is a draft version of the code. > Resync discarded directories in fs.name.dir during saveNamespace command > ------------------------------------------------------------------------ > > Key: HDFS-1509 > URL: https://issues.apache.org/jira/browse/HDFS-1509 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Reporter: dhruba borthakur > Assignee: dhruba borthakur > Attachments: resyncBadNameDir1.txt > > > In the current implementation, if the Namenode encounters an error while writing to a fs.name.dir directory it stops writing new edits to that directory. My proposal is to make the namenode write the fsimage to all configured directories in fs.name.dir, and from then on, continue writing fsedits to all configured directories. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.