hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yongjun Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4420) Provide a way to exclude subtree from balancing process
Date Wed, 16 Apr 2014 14:04:22 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13971424#comment-13971424

Yongjun Zhang commented on HDFS-4420:

HI [~shmuma], thanks for your earlier work on this JIRA. I wonder if you can update with an
updated patch? thanks a lot.

> Provide a way to exclude subtree from balancing process
> -------------------------------------------------------
>                 Key: HDFS-4420
>                 URL: https://issues.apache.org/jira/browse/HDFS-4420
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer
>            Reporter: Max Lapan
>            Priority: Minor
>         Attachments: Balancer-exclude-subtree-0.90.2.patch, Balancer-exclude-trunk-v2.patch,
Balancer-exclude-trunk-v3.patch, Balancer-exclude-trunk.patch, HDFS-4420-v4.patch
> During balancer operation, it balances all blocks, regardless of their filesystem hierarchy.
Sometimes, it would be usefull to exclude some subtree from balancing process.
> For example, regionservers data locality is cruical for HBase performance. Region's data
is tied to regionservers, which reside on specific machines in cluster. During operation,
regionservers reads and writes region's data, and after some time, all this data are reside
on local machine, so, all reads become local, which is great for performance. Balancer breaks
this locality during opertation by moving blocks around.
> This patch adds [-exclude <path>] switch, and, if path is provided,
> balancer will not move blocks under this path during operation.
> Attached patch have tested for 0.90.2.

This message was sent by Atlassian JIRA

View raw message