hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7497) Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui
Date Fri, 12 Dec 2014 14:39:20 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244198#comment-14244198
] 

Hudson commented on HDFS-7497:
------------------------------

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #36 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/36/])
HDFS-7497. Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode
webui. Contributed by Yongjun Zhang. (wang: rev b437f5eef40874287d4fbf9d8e43f1a857b5621f)
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestDecommissioningStatus.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java


> Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui
> ------------------------------------------------------------------------------------
>
>                 Key: HDFS-7497
>                 URL: https://issues.apache.org/jira/browse/HDFS-7497
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode, namenode
>            Reporter: Yongjun Zhang
>            Assignee: Yongjun Zhang
>              Labels: supportability
>             Fix For: 2.7.0
>
>         Attachments: HDFS-7497.001.patch
>
>
> It's observed that dfsadmin report list DNs in the decomm state while NN UI list DNs
in dead state.
> I found what happens is:
> NN webui uses two steps to get the result:
> * first collect a list of all alive DNs, 
> * traverse through all live  DNs to find decommissioning DNs. 
> It calls the following method to decide whether a DN is dead or alive:
> {code}
>   /** Is the datanode dead? */
>   boolean isDatanodeDead(DatanodeDescriptor node) {
>     return (node.getLastUpdate() <
>             (Time.now() - heartbeatExpireInterval));
>   }
> {code}
> On the other hand, dfsadmin traverse all DNs to find to all decommissioning DNs (check
whether a DN is in {{AdminStates.DECOMMISSION_INPROGRESS}} state), without checking whether
a DN is dead or alive like above.
> The problem is, when a DN is determined to be dead, its state may still be {{AdminStates.DECOMMISSION_INPROGRESS}}
.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message