Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AB89FCE8D for ; Fri, 27 Apr 2012 03:52:27 +0000 (UTC) Received: (qmail 72285 invoked by uid 500); 27 Apr 2012 03:52:26 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 72021 invoked by uid 500); 27 Apr 2012 03:52:24 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 71986 invoked by uid 99); 27 Apr 2012 03:52:22 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Apr 2012 03:52:22 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Apr 2012 03:52:21 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 588D340D7ED for ; Fri, 27 Apr 2012 03:52:01 +0000 (UTC) Date: Fri, 27 Apr 2012 03:52:01 +0000 (UTC) From: "Ashish Singhi (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <399629030.1341.1335498721377.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <959420845.33386.1334678418770.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HDFS-3286) When the threshold value for balancer is 0(zero) ,unexpected output is displayed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HDFS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263330#comment-13263330 ] Ashish Singhi commented on HDFS-3286: ------------------------------------- {code} -1 core tests. The patch failed these unit tests: org.apache.hadoop.fs.TestUrlStreamHandler {code} Not related to this fix. > When the threshold value for balancer is 0(zero) ,unexpected output is displayed > -------------------------------------------------------------------------------- > > Key: HDFS-3286 > URL: https://issues.apache.org/jira/browse/HDFS-3286 > Project: Hadoop HDFS > Issue Type: Bug > Components: balancer > Affects Versions: 0.23.0 > Reporter: J.Andreina > Assignee: Ashish Singhi > Fix For: 0.24.0 > > Attachments: HDFS-3286.patch, HDFS-3286.patch > > > Replication factor =1 > Step 1: Start NN,DN1.write 4 GB of data > Step 2: Start DN2 > Step 3: issue the balancer command(./hdfs balancer -threshold 0) > The threshold parameter is a fraction in the range of (0%, 100%) with a default value of 10% > When the above scenario is executed the Source DN and Target DN is choosen and the number of bytes to be moved from source to target DN is also calculated . > Then the balancer is exiting with the following message "No block can be moved. Exiting..." which is not expected. > {noformat} > HOST-xx-xx-xx-xx:/home/Andreina/APril10/install/hadoop/namenode/bin # ./hdfs balancer -threshold 0 > 12/04/16 16:22:07 INFO balancer.Balancer: Using a threshold of 0.0 > 12/04/16 16:22:07 INFO balancer.Balancer: namenodes = [hdfs://HOST-xx-xx-xx-xx:9000] > 12/04/16 16:22:07 INFO balancer.Balancer: p = Balancer.Parameters[BalancingPolicy.Node, threshold=0.0] > Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved > 12/04/16 16:22:10 INFO net.NetworkTopology: Adding a new node: /default-rack/yy.yy.yy.yy:50176 > 12/04/16 16:22:10 INFO net.NetworkTopology: Adding a new node: /default-rack/xx.xx.xx.xx:50010 > 12/04/16 16:22:10 INFO balancer.Balancer: 1 over-utilized: [Source[xx.xx.xx.xx:50010, utilization=7.212458091389678]] > 12/04/16 16:22:10 INFO balancer.Balancer: 1 underutilized: [BalancerDatanode[yy.yy.yy.yy:50176, utilization=4.650670324367203E-5]] > 12/04/16 16:22:10 INFO balancer.Balancer: Need to move 1.77 GB to make the cluster balanced. > No block can be moved. Exiting... > Balancing took 5.142 seconds > {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira