hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4420) Provide a way to exclude subtree from balancing process
Date Mon, 15 Jul 2013 13:52:50 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13708464#comment-13708464
] 

Hadoop QA commented on HDFS-4420:
---------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12592319/HDFS-4420-v4.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified
test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of
javac compiler warnings.

    {color:green}+1 javadoc{color}.  The javadoc tool did not generate any warning messages.

    {color:red}-1 eclipse:eclipse{color}.  The patch failed to build with eclipse:eclipse.

    {color:green}+1 findbugs{color}.  The patch does not introduce any new Findbugs (version
1.3.9) warnings.

        {color:red}-1 release audit{color}.  The applied patch generated 1 release audit warnings.

    {color:red}-1 core tests{color}.  The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

                  org.apache.hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup

    {color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/4653//testReport/
Release audit warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/4653//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/4653//console

This message is automatically generated.
                
> Provide a way to exclude subtree from balancing process
> -------------------------------------------------------
>
>                 Key: HDFS-4420
>                 URL: https://issues.apache.org/jira/browse/HDFS-4420
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: balancer
>            Reporter: Max Lapan
>            Priority: Minor
>         Attachments: Balancer-exclude-subtree-0.90.2.patch, Balancer-exclude-trunk.patch,
Balancer-exclude-trunk-v2.patch, Balancer-exclude-trunk-v3.patch, HDFS-4420-v4.patch
>
>
> During balancer operation, it balances all blocks, regardless of their filesystem hierarchy.
Sometimes, it would be usefull to exclude some subtree from balancing process.
> For example, regionservers data locality is cruical for HBase performance. Region's data
is tied to regionservers, which reside on specific machines in cluster. During operation,
regionservers reads and writes region's data, and after some time, all this data are reside
on local machine, so, all reads become local, which is great for performance. Balancer breaks
this locality during opertation by moving blocks around.
> This patch adds [-exclude <path>] switch, and, if path is provided,
> balancer will not move blocks under this path during operation.
> Attached patch have tested for 0.90.2.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message