Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3B7D2182BB for ; Tue, 28 Jul 2015 00:40:11 +0000 (UTC) Received: (qmail 38663 invoked by uid 500); 28 Jul 2015 00:40:04 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 38608 invoked by uid 500); 28 Jul 2015 00:40:04 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 38594 invoked by uid 99); 28 Jul 2015 00:40:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Jul 2015 00:40:04 +0000 Date: Tue, 28 Jul 2015 00:40:04 +0000 (UTC) From: "Tsz Wo Nicholas Sze (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-3411) Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643677#comment-14643677 ] Tsz Wo Nicholas Sze commented on HDFS-3411: ------------------------------------------- {quote} Now DN1 is added into aboveAvgUtilizedDatanodes and DN2 into belowAvgUtilizedDatanodes. Hence overLoadedBytes and underLoadedBytes will be equal to 0. Resulting in bytesLeftToMove equal to 0. Thus balancer will exit without balancing the blocks. {quote} Everything works as expected. Nothing to balancer since both DN1 and DN2 are within threshold. > Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes. > ----------------------------------------------------------------------------------------- > > Key: HDFS-3411 > URL: https://issues.apache.org/jira/browse/HDFS-3411 > Project: Hadoop HDFS > Issue Type: Bug > Components: balancer & mover > Affects Versions: 0.23.0 > Reporter: Ashish Singhi > > Scaenario: > replication set to 1. > 1. Start 1NN and IDN > 2. pump 1GB of data. > 3. Start one more DN > 4. Run balancer with threshold 1. > Now DN1 is added into aboveAvgUtilizedDatanodes and DN2 into belowAvgUtilizedDatanodes. Hence overLoadedBytes and underLoadedBytes will be equal to 0. Resulting in bytesLeftToMove equal to 0. Thus balancer will exit without balancing the blocks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)