hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Foley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1541) Not marking datanodes dead When namenode in safemode
Date Sat, 05 Mar 2011 02:06:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13002904#comment-13002904
] 

Matt Foley commented on HDFS-1541:
----------------------------------

Hi Hairong,
This patch uses isPopulatingReplQueues() as a proxy for being in startup mode.  Is it best
to start de-registering datanodes as soon as the repl queues are started, or should it wait
until the system actually leaves safe mode?

If the issue is that it should wait until leaving safe mode, but only when it is in "startup
safemode", that relates to HDFS-1726.
Thanks.

> Not marking datanodes dead When namenode in safemode
> ----------------------------------------------------
>
>                 Key: HDFS-1541
>                 URL: https://issues.apache.org/jira/browse/HDFS-1541
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: name-node
>    Affects Versions: 0.23.0
>            Reporter: Hairong Kuang
>            Assignee: Hairong Kuang
>             Fix For: 0.23.0
>
>         Attachments: deadnodescheck.patch
>
>
> In a big cluster, when namenode starts up,  it takes a long time for namenode to process
block reports from all datanodes. Because heartbeats processing get delayed, some datanodes
are erroneously marked as dead, then later on they have to register again, thus wasting time.
> It would speed up starting time if the checking of dead nodes is disabled when namenode
in safemode.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message