hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-3411) Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes.
Date Tue, 28 Jul 2015 00:40:04 GMT

    [ https://issues.apache.org/jira/browse/HDFS-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643677#comment-14643677
] 

Tsz Wo Nicholas Sze commented on HDFS-3411:
-------------------------------------------

{quote}
Now DN1 is added into aboveAvgUtilizedDatanodes and DN2 into belowAvgUtilizedDatanodes. Hence
overLoadedBytes and underLoadedBytes will be equal to 0. Resulting in bytesLeftToMove equal
to 0. Thus balancer will exit without balancing the blocks.
{quote}

Everything works as expected.  Nothing to balancer since both DN1 and DN2 are within threshold.

> Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes.
> -----------------------------------------------------------------------------------------
>
>                 Key: HDFS-3411
>                 URL: https://issues.apache.org/jira/browse/HDFS-3411
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: balancer & mover
>    Affects Versions: 0.23.0
>            Reporter: Ashish Singhi
>
> Scaenario:
> replication set to 1.
> 1. Start 1NN and IDN
> 2. pump 1GB of data.
> 3. Start one more DN
> 4. Run balancer with threshold 1.
> Now DN1 is added into aboveAvgUtilizedDatanodes and DN2 into belowAvgUtilizedDatanodes.
Hence overLoadedBytes and underLoadedBytes will be equal to 0. Resulting in bytesLeftToMove
equal to 0. Thus balancer will exit without balancing the blocks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message