hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-10517) DiskBalancer: Support help command
Date Sun, 12 Jun 2016 03:58:20 GMT

     [ https://issues.apache.org/jira/browse/HDFS-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Anu Engineer updated HDFS-10517:
--------------------------------
    Attachment: HDFS-10517-HDFS-1312.001.patch

The following is the output of this command.
{noformat}

./hdfs diskbalancer -help
usage: hdfs diskbalancer [command] [options]

DiskBalancer distributes data evenly between different disks on a
datanode. DiskBalancer operates by generating a plan, that tells datanode
how to move data between disks. Users can execute a plan by submitting it
to the datanode.
To get specific help on a particular command please run
hdfs diskbalancer -help <command>.
    --help <help>   valid commands are plan | execute | query | cancel |
                    report


./hdfs diskbalancer -help plan
usage: hdfs diskbalancer -uri <namenode> -plan <hostname> [options]
creates a plan that describes how much data should be moved between disks.

    --bandwidth <arg>             Maximum disk bandwidth to be consumed by
                                  diskBalancer. e.g. 10
    --maxerror <arg>              Describes how many errors can be
                                  tolerated while copying between a pair
                                  of disks.
    --out <arg>                   File to write output to, if not
                                  specified defaults will be used.
    --plan <arg>                  creates a plan for datanode.
    --thresholdPercentage <arg>   Percentage skew that wetolerate before
                                  diskbalancer starts working e.g. 10
    --uri <arg>                   Address of the Namenode. e,g.
                                  hdfs://namenode
    --v                           Print out the summary of the plan on
                                  console

Plan command creates a set of steps that represent a planned data move. A
plan file can be executed on a data node, which will balance the data.

./hdfs diskbalancer -help execute
usage: hdfs diskbalancer -execute <planfile>
Execute command runs a submits a plan for execution on the given data
node.
    --execute <arg>   Takes a plan file and submits it for execution by
                      the datanode.

Execute command submits the job to data node and returns immediately. The
state of job can be monitored via query command.



./hdfs diskbalancer -help query
usage: hdfs diskbalancer -query <hostname>  [options]
Query Plan queries a given data node about the current state of disk
balancer execution.
    --query <arg>   Queries the disk balancer status of a given datanode.
    --v             Prints details of the plan that is being executed on
                    the node.

Query command retrievs the plan ID and the current running state.



./hdfs diskbalancer -help cancel
usage: hdfs diskbalancer -cancel <planFile> | -cancel <planID> -node
            <hostname>
Cancel command cancels a running disk balancer operation.

    --cancel <arg>   Cancels a running plan using a plan file.
    --node <arg>     Cancels a running plan using a plan ID and hostName

Cancel command can be run via pointing to a plan file, or by reading the
plan ID using the query command and then using planID and hostname.
Examples of how to run this command are
hdfs diskbalancer -cancel <planfile>
hdfs diskbalancer -cancel <planID> -node <hostname>


./hdfs diskbalancer -help query
usage: hdfs diskbalancer -query <hostname>  [options]
Query Plan queries a given data node about the current state of disk
balancer execution.
    --query <arg>   Queries the disk balancer status of a given datanode.
    --v             Prints details of the plan that is being executed on
                    the node.

Query command retrievs the plan ID and the current running state.


./hdfs diskbalancer -help report
usage: hdfs diskbalancer -uri http://namenode.uri -report [options]
Report command reports the volume information of a given datanode, or
prints out the list of nodes that will benefit from running disk balancer.
Top defaults to 100
 -node <arg>   Datanode address, it can be DataNodeID, IP or hostname.
    --report   List nodes that will benefit from running DiskBalancer.
 -top <arg>    specify the number of nodes to be listed which has data
               imbalance.
. E.g.:
hdfs diskbalancer -uri http://namenode.uri -report
hdfs diskbalancer -uri http://namenode.uri -report -top 5
hdfs diskbalancer -uri http://namenode.uri -report -node {DataNodeID | IP
| Hostname}

{noformat}

> DiskBalancer: Support help command
> ----------------------------------
>
>                 Key: HDFS-10517
>                 URL: https://issues.apache.org/jira/browse/HDFS-10517
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover
>    Affects Versions: HDFS-1312
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>             Fix For: HDFS-1312
>
>         Attachments: HDFS-10517-HDFS-1312.001.patch
>
>
> Support -help <function> option in the disk balancer CLI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org


Mime
View raw message