hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacob Olsen <ja...@urbanverb.com>
Subject balancer size discrepancy
Date Mon, 21 Dec 2009 22:18:45 GMT
When I run the balancer, it says it's moving 10G, but after those 10G are moved, it's reported
that only ~ 1G is moved.

What could be causing this discrepancy?

Thanks so much in advance for your help.

--jake

2009-12-21 21:53:25,967 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: 1 over utilized
nodes: 172.18.141.95:50010
2009-12-21 21:53:25,967 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: 0 under utilized
nodes: 
2009-12-21 21:53:25,967 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: Need to move
292.74 GB bytes to make the cluster balanced.
2009-12-21 21:53:25,968 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: Decided to move
10 GB bytes from 172.18.141.95:50010 to 172.18.141.98:50010
2009-12-21 21:53:25,968 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: Will move 10
GBbytes in this iteration

..... moving blocks .....

2009-12-21 22:15:56,249 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: 1 over utilized
nodes: 172.18.141.95:50010
2009-12-21 22:15:56,249 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: 0 under utilized
nodes: 
2009-12-21 22:15:56,249 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: Need to move
291.4 GB bytes to make the cluster balanced.
2009-12-21 22:15:56,249 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: Decided to move
10 GB bytes from 172.18.141.95:50010 to 172.18.141.96:50010
2009-12-21 22:15:56,249 INFO org.apache.hadoop.hdfs.server.balancer.Balancer: Will move 10
GBbytes in this iteration

Mime
View raw message