Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 62B7711D85 for ; Tue, 22 Apr 2014 23:54:25 +0000 (UTC) Received: (qmail 93894 invoked by uid 500); 22 Apr 2014 23:54:19 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 93840 invoked by uid 500); 22 Apr 2014 23:54:18 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 93792 invoked by uid 99); 22 Apr 2014 23:54:17 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Apr 2014 23:54:17 +0000 Date: Tue, 22 Apr 2014 23:54:17 +0000 (UTC) From: "Tsz Wo Nicholas Sze (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977636#comment-13977636 ] Tsz Wo Nicholas Sze commented on HDFS-2975: ------------------------------------------- Is this still a problem? > Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). > ----------------------------------------------------------------------------------------------- > > Key: HDFS-2975 > URL: https://issues.apache.org/jira/browse/HDFS-2975 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode > Affects Versions: 0.24.0 > Reporter: Uma Maheswara Rao G > Assignee: Uma Maheswara Rao G > > When we rename the file with overwrite flag as true, it will delete the destination file blocks. After deleting the blocks, whenever it releases the fsNameSystem lock, NN can give the invalidation work to corresponding DNs to delete the blocks. > Parallaly it will sync the rename related edits to editlog file. At this step before NN sync the edits if NN crashes, NN can stuck into safemode on restart. This is because block already deleted from the DN as part of invalidations. But dst file still exist as rename edits not persisted in log file and no DN will report that blocks now. > This is similar to HDFS-2815 > -- This message was sent by Atlassian JIRA (v6.2#6252)