hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tanping Wang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-1773) Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists
Date Mon, 02 May 2011 21:21:03 GMT

     [ https://issues.apache.org/jira/browse/HDFS-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tanping Wang updated HDFS-1773:
-------------------------------

    Attachment: HDFS-1867.patch

Upload the patch generated for trunk(with Federation).

"Hide/not display/forget" an already decommissioned data node who is neither in include nor
exclude hosts lists from the list of live or dead nodes. This is being found useful for operators
to make the cluster forget a decommissioned data node. The operation procedure is as following:
Step I: Host must have been in the include hosts list and the include hosts list must not
be empty.
Step II: Host is decommissioned by remaining in the include hosts list and added into the
exclude hosts list. Name node is updated with the new information by issuing dfsadmin -refreshNodes
command.
Step III: Host is removed from both include hosts and exclude hosts lists. Name node is updated
with the new information by issuing dfsamin -refreshNodes command.

Couple variations to consider:

   1. Step II variation ( all the other steps are the same), if a node is added into exclude
list, but removed from include list, the node will appear as dead node.
   2. Step III variation (all the other steps are the same), if a node remains in
      the include list, but removed from exclude list, the node will rejoin as a
      live node.



> Remove a datanode from cluster if include list is not empty and this datanode is removed
from both include and exclude lists
> ----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-1773
>                 URL: https://issues.apache.org/jira/browse/HDFS-1773
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 0.20.203.1, 0.23.0
>         Environment: branch-20-security
>            Reporter: Tanping Wang
>            Assignee: Tanping Wang
>            Priority: Minor
>             Fix For: 0.20.204.0, 0.23.0
>
>         Attachments: HDFS-1773-2.patch, HDFS-1773-3.patch, HDFS-1773.patch, HDFS-1867.patch
>
>
> Our service engineering team who operates the clusters on a daily basis founds it is
confusing that after a data node is decommissioned, there is no way to make the cluster forget
about this data node and it always remains in the dead node list.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message