hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jitendra Nath Pandey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-8824) Do not use small blocks for balancing the cluster
Date Fri, 14 Aug 2015 05:48:45 GMT

    [ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696520#comment-14696520
] 

Jitendra Nath Pandey commented on HDFS-8824:
--------------------------------------------

+1 for the latest patch.

> Do not use small blocks for balancing the cluster
> -------------------------------------------------
>
>                 Key: HDFS-8824
>                 URL: https://issues.apache.org/jira/browse/HDFS-8824
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>         Attachments: h8824_20150727b.patch, h8824_20150811b.patch
>
>
> Balancer gets datanode block lists from NN and then move the blocks in order to balance
the cluster.  It should not use the blocks with small size since moving the small blocks generates
a lot of overhead and the small blocks do not help balancing the cluster much.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message