Mailing-List: contact core-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: core-dev@hadoop.apache.org
Message-ID: <2054734010.1215477631699.JavaMail.jira@brutus>
Date: Mon, 7 Jul 2008 17:40:31 -0700 (PDT)
From: "Konstantin Shvachko (JIRA)" <jira@apache.org>
To: core-dev@hadoop.apache.org
Subject: [jira] Updated: (HADOOP-3002) HDFS should not remove blocks while
 in safemode.
In-Reply-To: <403268954.1205283046764.JavaMail.jira@brutus>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


     [ https://issues.apache.org/jira/browse/HADOOP-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Konstantin Shvachko updated HADOOP-3002:
----------------------------------------

    Attachment: DelBlocksInSafeMode.patch

This is a new patch, which does not change heartbeat processing.
The global lock issue will be taken care of by HADOOP-3620.

> HDFS should not remove blocks while in safemode.
> ------------------------------------------------
>
>                 Key: HADOOP-3002
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3002
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.16.0
>            Reporter: Konstantin Shvachko
>            Assignee: Konstantin Shvachko
>            Priority: Blocker
>             Fix For: 0.17.2, 0.18.0
>
>         Attachments: DelBlocksInSafeMode-018.patch, DelBlocksInSafeMode.patch, DelBlocksInSafeMode.patch
>
>
> I noticed that data-nodes are removing blocks during a rather prolonged distributed upgrade when the name-node is in safe mode.
> This happened on my experimental cluster with accelerated block report rate.
> By definition in safe mode the name-node should not
> - accept client requests to change the namespace state, and
> - schedule block replications and/or block removal for the data-nodes.
> We don't want any unnecessary replications until all blocks are reported during startup.
> We also don't want to remove blocks if safe mode is entered manually.
> In heartbeat processing we explicitly verify that the name-node is in safe-mode and do not return any block commands to the data-nodes.
> Block reports can also return block commands, which should be banned during safe mode.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.