hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-3002) HDFS should not remove blocks while in safemode.
Date Wed, 12 Mar 2008 00:50:46 GMT
HDFS should not remove blocks while in safemode.

                 Key: HADOOP-3002
                 URL: https://issues.apache.org/jira/browse/HADOOP-3002
             Project: Hadoop Core
          Issue Type: Bug
          Components: dfs
            Reporter: Konstantin Shvachko
            Priority: Critical
             Fix For: 0.16.2, 0.17.0

I noticed that data-nodes are removing blocks during a rather prolonged distributed upgrade
when the name-node is in safe mode.
This happened on my experimental cluster with accelerated block report rate.
By definition in safe mode the name-node should not
- accept client requests to change the namespace state, and
- schedule block replications and/or block removal for the data-nodes.

We don't want any unnecessary replications until all blocks are reported during startup.
We also don't want to remove blocks if safe mode is entered manually.
In heartbeat processing we explicitly verify that the name-node is in safe-mode and do not
return any block commands to the data-nodes.
Block reports can also return block commands, which should be banned during safe mode.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message