hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From cmcc...@apache.org
Subject git commit: HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via Colin P. McCabe)
Date Wed, 22 Oct 2014 20:28:23 GMT
Repository: hadoop
Updated Branches:
  refs/heads/trunk 90e5ca24f -> 66e8187ea


HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via Colin P. McCabe)


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/66e8187e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/66e8187e
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/66e8187e

Branch: refs/heads/trunk
Commit: 66e8187ea1dbc6230ab2c633e4f609a7068b75db
Parents: 90e5ca2
Author: Colin Patrick Mccabe <cmccabe@cloudera.com>
Authored: Wed Oct 22 13:27:51 2014 -0700
Committer: Colin Patrick Mccabe <cmccabe@cloudera.com>
Committed: Wed Oct 22 13:27:51 2014 -0700

----------------------------------------------------------------------
 hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt     |  3 +++
 .../src/site/apt/HDFSCommands.apt.vm            |  7 +++++++
 .../src/site/apt/HdfsUserGuide.apt.vm           | 20 ++++++++++++++++++++
 3 files changed, 30 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/hadoop/blob/66e8187e/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
index 258c509..5ecb6ec 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -284,6 +284,9 @@ Release 2.7.0 - UNRELEASED
 
     HDFS-7221. TestDNFencingWithReplication fails consistently. (Charles Lamb via wang)
 
+    HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via
+    Colin P. McCabe)
+
   OPTIMIZATIONS
 
   BUG FIXES

http://git-wip-us.apache.org/repos/asf/hadoop/blob/66e8187e/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
index 32dc6d1..092f4c7 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
+++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
@@ -194,6 +194,7 @@ HDFS Commands Guide
           [-refreshSuperUserGroupsConfiguration]
           [-refreshCallQueue]
           [-refresh <host:ipc_port> <key> [arg1..argn]]
+          [-reconfig <datanode|...> <host:ipc_port> <start|status>]
           [-printTopology]
           [-refreshNamenodes datanodehost:port]
           [-deleteBlockPool datanode-host:port blockpoolId [force]]
@@ -287,6 +288,12 @@ HDFS Commands Guide
                   | of the resource specified by \<key\> on \<host:ipc_port\>.
                   | All other args after are sent to the host.
 *-----------------+-----------------------------------------------------------+
+| -reconfig <datanode|...> <host:ipc_port> <start|status> | Start
+                  | reconfiguration or get the status of an ongoing
+                  | reconfiguration. The second parameter specifies the node
+                  | type. Currently, only reloading DataNode's configuration is
+                  | supported.
+*-----------------+-----------------------------------------------------------+
 | -printTopology  | Print a tree of the racks and their nodes as reported by
                   | the Namenode
 *-----------------+-----------------------------------------------------------+

http://git-wip-us.apache.org/repos/asf/hadoop/blob/66e8187e/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
index 55208c9..25a466e 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
+++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
@@ -486,6 +486,26 @@ HDFS Users Guide
     This is because data inconsistency can result if an edit log operation
     refers to the destination of an automatically renamed file.
 
+* DataNode Hot Swap Drive
+
+   Datanode supports hot swappable drives. The user can add or replace HDFS data
+   volumes without shutting down the DataNode. The following briefly describes
+   the typical hot swapping drive procedure:
+
+     * If there are new storage directories, the user should format them and mount them
+       appropriately.
+
+     * The user updates the DataNode configuration <<<dfs.datanode.data.dir>>>
+       to reflect the data volume directories that will be actively in use.
+
+     * The user runs <<<dfsadmin -reconfig datanode HOST:PORT start>>>
to start
+       the reconfiguration process. The user can use <<<dfsadmin -reconfig
+       datanode HOST:PORT status>>> to query the running status of the reconfiguration
+       task.
+
+     * Once the reconfiguration task has completed, the user can safely <<<umount>>>
+       the removed data volume directories and physically remove the disks.
+
 * File Permissions and Security
 
    The file permissions are designed to be similar to file permissions on


Mime
View raw message