Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 17654C82A for ; Sat, 26 May 2012 10:09:26 +0000 (UTC) Received: (qmail 36167 invoked by uid 500); 26 May 2012 10:09:25 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 35918 invoked by uid 500); 26 May 2012 10:09:25 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 35861 invoked by uid 99); 26 May 2012 10:09:24 -0000 Received: from issues-vm.apache.org (HELO issues-vm) (140.211.11.160) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 26 May 2012 10:09:24 +0000 Received: from isssues-vm.apache.org (localhost [127.0.0.1]) by issues-vm (Postfix) with ESMTP id BD1311404AC for ; Sat, 26 May 2012 10:09:23 +0000 (UTC) Date: Sat, 26 May 2012 10:09:23 +0000 (UTC) From: "Ashish Singhi (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: <603845485.5575.1338026963777.JavaMail.jiratomcat@issues-vm> In-Reply-To: <247908105.255.1334746662268.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Updated] (HDFS-3295) Mismatch in number of bytes already moved and number of bytes being moved in balancer report MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-3295?page=3Dcom.atlassian= .jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Singhi updated HDFS-3295: -------------------------------- Attachment: HDFS-3295.patch =20 > Mismatch in number of bytes already moved and number of bytes being moved= in balancer report > -------------------------------------------------------------------------= ------------------- > > Key: HDFS-3295 > URL: https://issues.apache.org/jira/browse/HDFS-3295 > Project: Hadoop HDFS > Issue Type: Bug > Components: balancer > Affects Versions: 0.23.0 > Reporter: J.Andreina > Assignee: Ashish Singhi > Fix For: 0.24.0 > > Attachments: HDFS-3295.patch, HDFS-3295.patch, HDFS-3295.patch, H= DFS-3295.patch > > > Scenario: > Replication factor =3D 1,fs.defaultFS=3Dhdfs://namenodeip:port,dfs.nameno= de.rpc-address=3Dnamenodeip:port. > step 1: started DN1.Pumped 4.67GB of data > step 2: started DN2. > step 3: issued the balancer cmd(./start-balancer.sh -threshold 1) > Totally 848.41 MB has been moved to 2DN and took 4 iterations to move t= he blocks to 2DN. > But in balancer output in all the iterations the number of bytes already = moved is alway 0KB and there is mismatch in the Bytes being moved with the= bytes left to move > Balancer output for 2nd Iteration > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D > {noformat} > Time Stamp Iteration# Bytes Already Moved Bytes Left To M= ove Bytes Being Moved > Apr 18, 2012 12:41:20 PM 0 0 KB 848.41= MB 151.18 MB > Apr 18, 2012 1:06:46 PM 1 0 KB 646.02= MB 151.18 MB > Apr 18, 2012 1:10:28 PM 2 0 KB 417.43= MB 151.18 MB > Apr 18, 2012 1:14:04 PM 3 0 KB 223.84= MB 151.18 MB > Apr 18, 2012 1:18:10 PM 4 0 KB 30.34= MB 151.18 MB{noformat} > In the above balancer output > =E2=80=A2Bytes already moved is 0KB > =E2=80=A2 In 3 rd iterarion Bytes left to move is 223.84 MB but Bytes bei= ng moved is 151.18 MB . So in next iteration the bytes left to move should = be 223.84 MB - 151.18 MB=20 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrato= rs: https://issues.apache.org/jira/secure/ContactAdministrators!default.jsp= a For more information on JIRA, see: http://www.atlassian.com/software/jira