hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Trivial Update of "DiskSetup" by RaviPhulari
Date Wed, 31 Mar 2010 04:21:09 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "DiskSetup" page has been changed by RaviPhulari.
The comment on this change is: Adding guide about limiting data node's disk usage..
http://wiki.apache.org/hadoop/DiskSetup?action=diff&rev1=7&rev2=8

--------------------------------------------------

  
  Pass a list of disks to the `dfs.data.dir` parameter, Hadoop will use all of the disks that
are available. When one goes offline it is taken out of consideration. Hadoop does not check
for the disk coming back -it assumes it is "gone". 
  
+ === How to limit Data node's disk usage? ===
+ 
+ Use dfs.datanode.du.reserved configuration value in $HADOOP_HOME/conf/hdfs-site.xml for
limiting disk usage.
+ 
+ {{{
+   <property>
+     <name>dfs.datanode.du.reserved</name>
+     <!-- cluster variant -->
+     <value>182400</value>
+     <description>Reserved space in bytes per volume. Always leave this much space
free for non dfs use.
+     </description>
+   </property>
+ }}}
  === Logging ===
  
   * The environment variable, `HADOOP_LOG_DIR` sets the directory Hadoop logs to.

Mime
View raw message