hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lk_hadoop"<lk_had...@163.com>
Subject hdfs didn't distribute data average with multiple disks
Date Tue, 14 Feb 2017 02:14:28 GMT
hi,all:
    on my datanode ,hava 12 disk ,but the consume was not blances :
    
node1:
[hadoop@master2 logs]$ df -h | grep hdfs
/dev/sdc1                3.6T  3.0T  466G  87% /hdfs/data3
/dev/sdb1                3.6T  3.0T  464G  87% /hdfs/data2
/dev/sdl1                3.6T  3.0T  464G  87% /hdfs/data12
/dev/sdd1                3.6T  2.4T  1.1T  69% /hdfs/data4
/dev/sdg1                3.6T  3.0T  412G  89% /hdfs/data7
/dev/sdj1                3.6T  3.0T  467G  87% /hdfs/data10
/dev/sdf1                3.6T  2.1T  1.4T  61% /hdfs/data6
/dev/sdk1                3.6T  3.0T  412G  89% /hdfs/data11
/dev/sde1                3.6T  399G  3.1T  12% /hdfs/data5
/dev/sdi1                3.6T  3.0T  412G  89% /hdfs/data9
/dev/sdh1                3.6T  3.0T  464G  87% /hdfs/data8
/dev/sda1                3.6T  3.0T  460G  87% /hdfs/data1

node2:
[hadoop@slave1 ~]$ df -h | grep hdfs
/dev/sdd1       3.6T  3.0T  454G  87% /hdfs/data4
/dev/sdj1       3.6T  2.8T  665G  81% /hdfs/data10
/dev/sdf1       3.6T  2.3T  1.2T  67% /hdfs/data6
/dev/sda1       3.6T  3.0T  458G  87% /hdfs/data1
/dev/sdl1       3.6T  3.0T  433G  88% /hdfs/data12
/dev/sdh1       3.6T  1.9T  1.6T  55% /hdfs/data8
/dev/sdb1       3.6T  3.0T  454G  87% /hdfs/data2
/dev/sdk1       3.6T  3.0T  455G  87% /hdfs/data11
/dev/sdg1       3.6T  1.7T  1.8T  49% /hdfs/data7
/dev/sde1       3.6T  2.6T  876G  75% /hdfs/data5
/dev/sdi1       3.6T  2.6T  849G  76% /hdfs/data9
/dev/sdc1       3.6T  3.0T  455G  87% /hdfs/data3


and maybe some disk Use% about 90% , when I run hdfs dfs -ls , was very slow.

1、 how can I blances  the usage of disks
2、 what to do to find any clue about  why the hdfs become slow

2017-02-14


lk_hadoop 
Mime
View raw message