hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-8824) Do not use small blocks for balancing the cluster
Date Tue, 28 Jul 2015 00:15:04 GMT

     [ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tsz Wo Nicholas Sze updated HDFS-8824:
--------------------------------------
    Issue Type: Sub-task  (was: Improvement)
        Parent: HDFS-8825

> Do not use small blocks for balancing the cluster
> -------------------------------------------------
>
>                 Key: HDFS-8824
>                 URL: https://issues.apache.org/jira/browse/HDFS-8824
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: h8824_20150727b.patch
>
>
> Balancer gets datanode block lists from NN and then move the blocks in order to balance
the cluster.  It should not use the blocks with small size since moving the small blocks generates
a lot of overhead and the small blocks do not help balancing the cluster much.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message