hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy
Date Wed, 02 Sep 2015 03:26:45 GMT
Ming Ma created HDFS-9007:

             Summary: Fix HDFS Balancer to honor upgrade domain policy
                 Key: HDFS-9007
                 URL: https://issues.apache.org/jira/browse/HDFS-9007
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Ming Ma

In the current design of HDFS Balancer, it doesn't use BlockPlacementPolicy used by namenode
runtime. Instead, it has somewhat redundant code to make sure block allocation conforms with
the rack policy.

When namenode uses upgrade domain based policy, we need to make sure that HDFS balancer doesn't
move blocks in a way that could violate upgrade domain block placement policy.

In the longer term, we should consider how to make Balancer independent of the actual BlockPlacementPolicy
as in HDFS-1431. 

This message was sent by Atlassian JIRA

View raw message