hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "caixiaofeng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations
Date Sat, 03 Feb 2018 07:14:02 GMT

    [ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351289#comment-16351289

caixiaofeng commented on HDFS-9761:

Mark ,Good job.

> Rebalancer sleeps too long between iterations
> ---------------------------------------------
>                 Key: HDFS-9761
>                 URL: https://issues.apache.org/jira/browse/HDFS-9761
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: balancer &amp; mover
>            Reporter: Adrian Bridgett
>            Assignee: Mingliang Liu
>            Priority: Blocker
>             Fix For: 2.8.0, 3.0.0-alpha1
>         Attachments: HDFS-9761.000.patch
> Whilst reading the code to try and determine why I'm seeing bad performance I think I've
spotted an inadvertent move of a sleep() to inside a for loop.
> This means that instead of sleeping once per iteration the balance is sleeping once per
namenode per iteration.  If I've done my maths correctly the sleep time default is 18seconds
so this is a nice little speedup for HA clusters.
> Commit d31a41c35927f02f2fb40d19380b5df4bb2b6d57 moved the sleep in org/apache/hadoop/hdfs/server/balancer/Balancer.java:run()

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message