hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "dhruba borthakur (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-1126) Optimize CPU usage when cluster restarts
Date Thu, 15 Mar 2007 23:10:09 GMT
Optimize CPU usage when cluster restarts

                 Key: HADOOP-1126
                 URL: https://issues.apache.org/jira/browse/HADOOP-1126
             Project: Hadoop
          Issue Type: Bug
          Components: dfs
            Reporter: dhruba borthakur
         Assigned To: Hairong Kuang

When the namenode restarts, all datanodes report their blocks to the namenode. The namenode
inserts these blocks into neededReplication(). When safemode exists, pendingTransfers removes
them from neededReplication. This is non-optimal because pendingTransfer consumes plenty of
CPU just after exiting safe-mode.

The problem is that neededReplications.remove(block) does not remove a block if oldExpectedReplicas
is exactly equal to oldReplicas.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message