hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Max Lapan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-4420) Provide a way to exclude subtree from balancing process
Date Fri, 18 Jan 2013 12:28:12 GMT
Max Lapan created HDFS-4420:

             Summary: Provide a way to exclude subtree from balancing process
                 Key: HDFS-4420
                 URL: https://issues.apache.org/jira/browse/HDFS-4420
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: balancer
    Affects Versions: 0.20.2
            Reporter: Max Lapan
            Priority: Minor
             Fix For: 0.20.2

During balancer operation, it balances all blocks, regardless of their filesystem hierarchy.
Sometimes, it would be usefull to exclude some subtree from balancing process.

For example, regionservers data locality is cruical for HBase performance. Region's data is
tied to regionservers, which reside on specific machines in cluster. During operation, regionservers
reads and writes region's data, and after some time, all this data are reside on local machine,
so, all reads become local, which is great for performance. Balancer breaks this locality
during opertation by moving blocks around.

This patch adds [-exclude <path>] switch, and, if path is provided,
balancer will not move blocks under this path during operation.

Attached patch have tested for 0.90.2.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message