hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Created: (HDFS-1147) Reduce NN startup time by reducing the processing time of block reports
Date Wed, 12 May 2010 05:22:41 GMT
Reduce NN startup time by reducing the processing time of block reports
-----------------------------------------------------------------------

                 Key: HDFS-1147
                 URL: https://issues.apache.org/jira/browse/HDFS-1147
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: name-node
            Reporter: dhruba borthakur


The NameNode restart times are impacted to a large extent by the processing time of block
reports. For a cluster with 150 millions blocks, the block report processing in the NN can
take upto 20 minutes or so. The NN is open for business only after it has processed the block
reports from most of the datanodes. If we can reduce the processing time of a block report,
that will directly reduce the restart time of the NN.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message