hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tianqiang Li <peter...@gmail.com>
Subject HDFS space missing after file deletion
Date Tue, 12 Oct 2010 22:21:55 GMT
I am new to hdfs management. Hope you guys help me on this.
I have a 12-node cluster, up to last week, I found the space usage of hdfs
was approaching to 75%, then I remove tens of thousands the files, which are
quite small ones, after deletion, i use *hadop fs -du / *, it shows only
11TB space are used.
*32296810        hdfs://hadoop-name01/hadoop
3506            hdfs://hadoop-name01/hbase
66,380,418,656     hdfs://hadoop-name01/tmp
10,280,770,071,939  hdfs://hadoop-name01/user*

but when I tried to use *hadoop fs -df /*, it said there are still 68% of
space are used.
*Filesystem              Size    Used    Avail   Use%
/               70767414312960  48673246151277  18472473866240  68%*

I am puzzled here since du said only 11T are used, but in df said 44T are
used. Also in dfsadmin report, 44TB is reported as used, any reason some
space(*33TB*) are missing after my deletion? Any light shed on me are highly

*$ hadoop dfsadmin -report*
*Configured Capacity: 70767414312960 (64.36 TB)
Present Capacity: 67143178552151 (61.07 TB)
DFS Remaining: 18416113192960 (16.75 TB)
DFS Used: 48727065359191 (44.32 TB)
DFS Used%: 72.57%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0*

Peter Li

View raw message