hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.
Date Tue, 22 Sep 2015 09:07:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902264#comment-14902264
] 

Hudson commented on HDFS-8780:
------------------------------

FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #430 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/430/])
HDFS-8780. Fetching live/dead datanode list with arg true for removeDecommissionNode,returns
list with decom node. (Contributed by J.Andreina) (vinayakumarb: rev 10ab7d595ece59f2d00b406ba8812c6295a4187f)
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
* hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java


> Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list
with decom node.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-8780
>                 URL: https://issues.apache.org/jira/browse/HDFS-8780
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: J.Andreina
>            Assignee: J.Andreina
>             Fix For: 2.8.0
>
>         Attachments: HDFS-8780.1.patch, HDFS-8780.2.patch, HDFS-8780.3.patch
>
>
> Current implementation: 
> ======================
> DatanodeManager#removeDecomNodeFromList() , Decommissioned node will be removed from
dead/live node list only if below conditions are met
>  I . If the Include list is not empty. 
>  II. If include and exclude list does not have decommissioned node and node state is
decommissioned. 
> {code}
>       if (!hostFileManager.hasIncludes()) {
>               return;
>        }
>       if ((!hostFileManager.isIncluded(node)) && (!hostFileManager.isExcluded(node))
>           && node.isDecommissioned()) {
>         // Include list is not empty, an existing datanode does not appear
>         // in both include or exclude lists and it has been decommissioned.
>         // Remove it from the node list.
>         it.remove();
>       }
> {code}
> As mentioned in javadoc a datanode cannot be in "already decommissioned datanode state".
> Following the steps mentioned in javadoc datanode state is "dead" and not decommissioned.
> *Can we avoid the unnecessary checks and have check for the node is in decommissioned
state then remove from node list. ?*
> Please provide your feedback.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message