hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suresh Srinivas (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-1703) HDFS federation: Improve start/stop scripts and add script to decommission datanodes
Date Thu, 10 Mar 2011 23:59:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005417#comment-13005417
] 

Suresh Srinivas commented on HDFS-1703:
---------------------------------------

Updated description:

The new startup script has the following changed behavior:
# Old behavior:
#* startup script had to be run on primary namenode. The script started namenode on the the
node where it was run. Secondary namenode was started on the node in "master" file. 
#* Datanodes were started on nodes that are in "slaves" file.
# New behavior:
#* Script determines namenodes and secondary namenodes from the hdfs-site.xml configuration
and starts appropriate nodes on these machines. The file "master" is no longer required.(Changed
behavior)
#* Datanodes were started on nodes that are in "slaves" file. (No change)

Installation using their own scripts can start the nodes, based on the example in this script.


Decommission tool:
# Two new scripts are added for performing decommissioning in federation setup. This could
be used for setup with single namenode also.
# distribute-exclude.sh
#* This script copies the given exclude file based to all the namenodes (discovered from the
configuration hdfs-site.xml) to the exclude file as definied in the hdfs-site.xml configuration.
# refresh-namenodes.sh
#* This script runs refreshNodes command on all the namenodes (discovered from the configuration
hdfs-site.xml).


> HDFS federation: Improve start/stop scripts and add script to decommission datanodes
> ------------------------------------------------------------------------------------
>
>                 Key: HDFS-1703
>                 URL: https://issues.apache.org/jira/browse/HDFS-1703
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: scripts
>    Affects Versions: Federation Branch
>            Reporter: Tanping Wang
>            Assignee: Tanping Wang
>            Priority: Minor
>             Fix For: Federation Branch
>
>         Attachments: HDFS-1703.patch
>
>
> This Jira covers two issues:
> # Startup scripts should start namenodes, secondary namenodes and datanodes on hosts
retunred by getConfig (new feature).  This patch is spread out to both common(HADOOP-7179)
and hdfs (this Jira).  
> # Decommission script to decommission datanodes

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message