hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7497) Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui
Date Thu, 11 Dec 2014 23:06:13 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243315#comment-14243315
] 

Hadoop QA commented on HDFS-7497:
---------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12686454/HDFS-7497.001.patch
  against trunk revision 614b6af.

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

    {color:green}+1 eclipse:eclipse{color}.  The patch built with eclipse:eclipse.

    {color:red}-1 findbugs{color}.  The patch appears to introduce 41 new Findbugs (version
2.0.3) warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number
of release audit warnings.

    {color:red}-1 core tests{color}.  The following test timeouts occurred in hadoop-hdfs-project/hadoop-hdfs:

org.apache.hadoop.hdfs.server.blockmanagement.TestDatanodeManager

Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/9009//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/9009//artifact/patchprocess/newPatchFindbugsWarningshadoop-hdfs.html
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/9009//console

This message is automatically generated.

> Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui
> ------------------------------------------------------------------------------------
>
>                 Key: HDFS-7497
>                 URL: https://issues.apache.org/jira/browse/HDFS-7497
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: datanode, namenode
>            Reporter: Yongjun Zhang
>            Assignee: Yongjun Zhang
>         Attachments: HDFS-7497.001.patch
>
>
> It's observed that dfsadmin report list DNs in the decomm state while NN UI list DNs
in dead state.
> I found what happens is:
> NN webui uses two steps to get the result:
> * first collect a list of all alive DNs, 
> * traverse through all live  DNs to find decommissioning DNs. 
> It calls the following method to decide whether a DN is dead or alive:
> {code}
>   /** Is the datanode dead? */
>   boolean isDatanodeDead(DatanodeDescriptor node) {
>     return (node.getLastUpdate() <
>             (Time.now() - heartbeatExpireInterval));
>   }
> {code}
> On the other hand, dfsadmin traverse all DNs to find to all decommissioning DNs (check
whether a DN is in {{AdminStates.DECOMMISSION_INPROGRESS}} state), without checking whether
a DN is dead or alive like above.
> The problem is, when a DN is determined to be dead, its state may still be {{AdminStates.DECOMMISSION_INPROGRESS}}
.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message