hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command
Date Mon, 31 Oct 2016 16:03:58 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622568#comment-15622568

Anu Engineer commented on HDFS-9462:

[~xiaobingo] based on our off-line discussion I am inclined to resolve this command as not
needed since it has significant overlap with report command. Please let me know if my understanding
is correct or if we still need this.

> DiskBalancer: Add Scan Command
> ------------------------------
>                 Key: HDFS-9462
>                 URL: https://issues.apache.org/jira/browse/HDFS-9462
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover
>    Affects Versions: 2.8.0
>            Reporter: Xiaobing Zhou
>            Assignee: Xiaobing Zhou
>         Attachments: HDFS-9462-HDFS-10576.001.patch, HDFS-9462-HDFS-1312.000.patch, HDFS-9462.002.patch,
HDFS-9462.003.patch, HDFS-9462.004.patch
> This is to propose being able to scan all the nodes that we send various plans to. In
order to do the scan, scan command will talk to all involved data nodes through cluster interface(HDFS-9449)
and data models(HDFS-9420) and compare the hash tag that it gets back to make sure that the
plan is that we are interested in and print out the results.
> As bonus, it should support the ability to print out the diff of what happened when a
DiskBalancer run is complete. Assuming the state of the cluster is saved to file before.json.
There should be two kinds of diffs:
> 1. Overall what happened in the cluster vs. before.json -- just a summary 
> 2. for a specific node -- just like report command we should be able to pass in a node
and as see the changes against the before.json

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message