hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <michael_se...@hotmail.com>
Subject RE: How do I remove "Non DFS Used"?
Date Wed, 07 Jul 2010 13:48:39 GMT

Non DFS used tends to be logging or some other information on the disk.

So you can't use hadoop commands to remove the files from the disk.



> Date: Wed, 7 Jul 2010 17:11:38 +0900
> Subject: How do I remove "Non DFS Used"?
> From: mp2893@gmail.com
> To: common-user@hadoop.apache.org
> 
> I was looking at the web interface and found that some of my nodes have
> enormous amount of "Non DFS Used".
> 
> There is even a node with 800GB of "Non DFS Used" which is just ridiculous.
> 
> I tried to remove them by doing:
> 
> "hadoop namenode -format"
> 
> and I also tried deleting "hadoop.tmp.dir" (in my case, which is
> /home/hadoop/hadoop_storage/tmp/).
> 
> But when I start my cluster again, there it is again with thousands of giga
> bytes of "Non DFS Used".
> 
> Can anyone tell me what "Non DFS Used" is and how to remove them forever?
> 
> Thanks in advance.
 		 	   		  
_________________________________________________________________
The New Busy is not the too busy. Combine all your e-mail accounts with Hotmail.
http://www.windowslive.com/campaign/thenewbusy?tile=multiaccount&ocid=PID28326::T:WLMTAGL:ON:WL:en-US:WM_HMP:042010_4
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message