hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From schubert zhang <zson...@gmail.com>
Subject HDFS unbalance issue. (HBase over HDFS)
Date Wed, 25 Mar 2009 09:12:18 GMT
Hi all,
I am using hbase-0.19.1 and hadoop-0.19.
My cluster have 5+1 nodes, and there are about 512 regions in HBase (256MB
per region).

But I found the blocks in HDFS is very unbalanced. Following is the status
from HDFS web GUI.

(Node: I don't know if this mailing list can display html!)

HDFS blocks:
node1   509036 blocks
node2   157937 blocks
node3   15783   blocks
node4   15117   blocks
node5   20158   blocks

But my HBase regions are very balanced.
node1   88   regions
node2   108 regions
node3   111 regions
node4   102 regions
node5   105 regions



NodeLast
ContactAdmin StateConfigured
Capacity (GB)Used
(GB)Non DFS
Used (GB)Remaining
(GB)Used
(%)Used
(%)Remaining
(%)Blocksnd1-rack0-cloud<http://nd1-rack0-cloud:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F>
0In Service822.8578.6743.28200.8670.3324.41509036nd2-rack0-cloud<http://nd2-rack0-cloud:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F>
0In Service822.8190.0242.96589.8223.0971.68157937nd3-rack0-cloud<http://nd3-rack0-cloud:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F>
0In Service822.851.9542.61728.246.3188.5115783nd4-rack0-cloud<http://nd4-rack0-cloud:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F>
6In Service822.846.1942.84733.775.6189.1815117nd5-rack0-cloud<http://nd5-rack0-cloud:50075/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F>
1In Service1215.6152.3762.911100.324.3190.5220158


But my HBase regions are very balanced.

AddressStart CodeLoadnd1-rack0-cloud:60020 <http://nd1-rack0-cloud:60030/>
1237967027050requests=383, regions=88, usedHeap=978, maxHeap=1991
nd2-rack0-cloud:60020 <http://nd2-rack0-cloud:60030/>1237788871362requests=422,
regions=108, usedHeap=1433,
maxHeap=1991nd3-rack0-cloud:60020<http://nd3-rack0-cloud:60030/>
1237788881667requests=962, regions=111, usedHeap=1534, maxHeap=1991
nd4-rack0-cloud:60020 <http://nd4-rack0-cloud:60030/>1237788859541requests=369,
regions=102, usedHeap=1059,
maxHeap=1991nd5-rack0-cloud:60020<http://nd5-rack0-cloud:60030/>
1237788899331requests=384, regions=105, usedHeap=1535,
maxHeap=1983Total:servers:
5 requests=2520, regions=514

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message