Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D1DAF17D33 for ; Mon, 8 Feb 2016 08:33:40 +0000 (UTC) Received: (qmail 51022 invoked by uid 500); 8 Feb 2016 08:33:40 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 50917 invoked by uid 500); 8 Feb 2016 08:33:40 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 50872 invoked by uid 99); 8 Feb 2016 08:33:40 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 08 Feb 2016 08:33:40 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 04E992C1F60 for ; Mon, 8 Feb 2016 08:33:40 +0000 (UTC) Date: Mon, 8 Feb 2016 08:33:40 +0000 (UTC) From: "Adrian Bridgett (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-9761) Rebalancer sleeps too long between iterations MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15136699#comment-15136699 ] Adrian Bridgett commented on HDFS-9761: --------------------------------------- You're most welcome. Really impressive JIRA/hudson setup - and especially how well and quickly you all communicate. Awesome to see in action :-) > Rebalancer sleeps too long between iterations > --------------------------------------------- > > Key: HDFS-9761 > URL: https://issues.apache.org/jira/browse/HDFS-9761 > Project: Hadoop HDFS > Issue Type: Bug > Components: balancer & mover > Reporter: Adrian Bridgett > Assignee: Mingliang Liu > Priority: Blocker > Fix For: 2.8.0 > > Attachments: HDFS-9761.000.patch > > > Whilst reading the code to try and determine why I'm seeing bad performance I think I've spotted an inadvertent move of a sleep() to inside a for loop. > This means that instead of sleeping once per iteration the balance is sleeping once per namenode per iteration. If I've done my maths correctly the sleep time default is 18seconds so this is a nice little speedup for HA clusters. > Commit d31a41c35927f02f2fb40d19380b5df4bb2b6d57 moved the sleep in org/apache/hadoop/hdfs/server/balancer/Balancer.java:run() -- This message was sent by Atlassian JIRA (v6.3.4#6332)