hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-855) namenode can save images in parallel to all directories in fs.name.dir
Date Sun, 27 Dec 2009 08:17:29 GMT
namenode can save images in parallel to all directories in fs.name.dir
----------------------------------------------------------------------

                 Key: HDFS-855
                 URL: https://issues.apache.org/jira/browse/HDFS-855
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: name-node
            Reporter: dhruba borthakur


The namenode restart times can be reduced if the namenode can save its image to multiple directories
(specified in fs.name.dir) in parallel.

The NN has a 6 GB fsimage and 1 MB edits file. The NN needed 10 minutes to load fsimage/edits
into memory. It needs 7 minutes to read the 6 GB image. There are two directories in fs.name.dir.
 it takes about 2 minute to save the image into first directory and another 2 minutes to save
the image to the second directory. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message