hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Charles Baker" <cba...@sdl.com>
Subject Balancer exiting before doing any work
Date Fri, 25 May 2012 23:16:38 GMT
Hey guys. I posted this on the CDH forum but no one has replied so I'm
posting here to reach a wider audience and hopefully an answer:

 

Has anyone here seen an issue where the balancer will exit before doing any
'balancing'? I'm setting a threshold of 2 but often times, no data will
actually get moved. There are no messages indicating any kind of problem in
the NameNode or in the DataNode logs. I'm using cdh3u1 which is based on
0.20.2.

 

12/05/21 17:04:14 INFO balancer.Balancer: Need to move 5.41 TB bytes to make
the cluster balanced. 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.43:50010 to 192.168.164.30:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.39:50010 to 192.168.164.19:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.45:50010 to 192.168.164.23:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.42:50010 to 192.168.164.6:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.46:50010 to 192.168.164.31:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.48:50010 to 192.168.164.32:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.49:50010 to 192.168.164.16:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.34:50010 to 192.168.164.24:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.51:50010 to 192.168.164.18:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.40:50010 to 192.168.164.22:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.50:50010 to 192.168.164.29:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.35:50010 to 192.168.164.21:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.41:50010 to 192.168.164.11:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.37:50010 to 192.168.164.13:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.52:50010 to 192.168.164.20:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.38:50010 to 192.168.164.15:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.44:50010 to 192.168.164.33:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.36:50010 to 192.168.164.27:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.47:50010 to 192.168.164.28:50010 
12/05/21 17:04:14 INFO balancer.Balancer: Will move 190 GBbytes in this
iteration 
May 21, 2012 5:04:14 PM           4                 0 KB 5.41 TB
190 GB 
No block has been moved for 5 iterations. Exiting... 
Balancing took 34.938 seconds 

 

Thanks! 

 

-Charles

 

SDL Enterprise Technologies, Inc. - all rights reserved.  The information contained in this
email may be confidential and/or legally privileged. It has been sent for the sole use of
the intended recipient(s). If you are not the intended recipient of this mail, you are hereby
notified that any unauthorized review, use, disclosure, dissemination, distribution, or copying
of this communication, or any of its contents, is strictly prohibited. If you have received
this communication in error, please reply to the sender and destroy all copies of the message.
Registered address: 69 Hickory Drive, 3rd Floor, Waltham, MA 02451, USA

Mime
View raw message