Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B774F116DF for ; Fri, 22 Aug 2014 14:34:14 +0000 (UTC) Received: (qmail 64155 invoked by uid 500); 22 Aug 2014 14:34:13 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 64094 invoked by uid 500); 22 Aug 2014 14:34:13 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 64080 invoked by uid 99); 22 Aug 2014 14:34:13 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Aug 2014 14:34:13 +0000 Date: Fri, 22 Aug 2014 14:34:13 +0000 (UTC) From: "Yi Liu (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-2975: ------------------------- Attachment: HDFS-2975.001.patch We need to remove blocks after logSync. > Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). > ----------------------------------------------------------------------------------------------- > > Key: HDFS-2975 > URL: https://issues.apache.org/jira/browse/HDFS-2975 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode > Affects Versions: 0.24.0 > Reporter: Uma Maheswara Rao G > Assignee: Yi Liu > Attachments: HDFS-2975.001.patch > > > When we rename the file with overwrite flag as true, it will delete the destination file blocks. After deleting the blocks, whenever it releases the fsNameSystem lock, NN can give the invalidation work to corresponding DNs to delete the blocks. > Parallaly it will sync the rename related edits to editlog file. At this step before NN sync the edits if NN crashes, NN can stuck into safemode on restart. This is because block already deleted from the DN as part of invalidations. But dst file still exist as rename edits not persisted in log file and no DN will report that blocks now. > This is similar to HDFS-2815 > -- This message was sent by Atlassian JIRA (v6.2#6252)