hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9005) Provide support for upgrade domain script
Date Tue, 08 Sep 2015 20:00:46 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735500#comment-14735500
] 

Ming Ma commented on HDFS-9005:
-------------------------------

Thanks [~cmccabe]. We could use XML or other file format. The script approach could allow
admins to regularly add machines to the cluster without any additional operation to update
NN with upgrade domain of these new machines. If we use the XML approach, we will need additional
steps to keep NN up to date such as a) use the script to generate updated XML file for the
new machines. b) have NN reload the XML file before it reloads dfs.hosts file. Sure these
steps can be automated. It is just somewhat easier for admins to use the script.

> Provide support for upgrade domain script
> -----------------------------------------
>
>                 Key: HDFS-9005
>                 URL: https://issues.apache.org/jira/browse/HDFS-9005
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Ming Ma
>
> As part of the upgrade domain feature, we need to provide a mechanism to specify upgrade
domain for each datanode. One way to accomplish that is to allow admins specify an upgrade
domain script that takes DN ip or hostname as input and return the upgrade domain. Then namenode
will use it at run time to set {{DatanodeInfo}}'s upgrade domain string. The configuration
can be something like:
> {noformat}
> <property>
> <name>dfs.namenode.upgrade.domain.script.file.name</name>
> <value>/etc/hadoop/conf/upgrade-domain.sh</value>
> </property>
> {noformat}
> just like topology script, 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message