hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-2718) Optimize OP_ADD in edits loading
Date Thu, 22 Dec 2011 19:37:31 GMT
Optimize OP_ADD in edits loading
--------------------------------

                 Key: HDFS-2718
                 URL: https://issues.apache.org/jira/browse/HDFS-2718
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: name-node
    Affects Versions: 0.22.0, 0.24.0, 1.0.0
            Reporter: Konstantin Shvachko


During loading the edits journal FSEditLog.loadEditRecords() processes OP_ADD inefficiently.
It first removes the existing INodeFile from the directory tree, then adds it back as a regular
INodeFile, and then replaces it with INodeFileUnderConstruction if files is not closed. This
slows down edits loading. OP_ADD should be done in one shot and retain previously existing
data.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message