hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).
Date Mon, 20 Feb 2012 07:35:49 GMT
Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).
-----------------------------------------------------------------------------------------------

                 Key: HDFS-2975
                 URL: https://issues.apache.org/jira/browse/HDFS-2975
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: name-node
    Affects Versions: 0.24.0
            Reporter: Uma Maheswara Rao G
            Assignee: Uma Maheswara Rao G


When we rename the file with overwrite flag as true, it will delete the destination file blocks.
After deleting the blocks, whenever it releases the fsNameSystem lock, NN can give the invalidation
work to corresponding DNs to delete the blocks.
Parallaly it will sync the rename related edits to editlog file. At this step before NN sync
the edits if NN crashes, NN can stuck into safemode on restart. This is because block already
deleted from the DN as part of invalidations. But dst file still exist as rename edits not
persisted in log file and no DN will report that blocks now.

This is similar to HDFS-2815
 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message