hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Hadoop Wiki] Update of "HDFS-RAID" by PatrickKling
Date Thu, 02 Dec 2010 19:57:23 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "HDFS-RAID" page has been changed by PatrickKling.
The comment on this change is: Added BlockFixer configuration option..
http://wiki.apache.org/hadoop/HDFS-RAID?action=diff&rev1=7&rev2=8

--------------------------------------------------

  
  === BlockFixer ===
  
- (currently under development)
- 
  The BlockFixer is a daemon that runs at the RaidNode and periodically inspects the health
of the paths for which DRFS is configured.
  When a file with missing or corrupt blocks is encountered, these blocks are recomputed and
inserted back into the file system.
  
  There are two implementations of the BlockFixer:
-  * the LocalBlockFixer, which recomputes bad blocks locally at the RaidNode.
+  * LocalBlockFixer, which recomputes bad blocks locally at the RaidNode.
-  * the DistributedBlockFixer, which dispatches map reduce jobs to recompute blocks.
+  * DistBlockFixer, which dispatches map reduce jobs to recompute blocks.
  
  === RaidShell ===
  
@@ -227, +225 @@

    {{{
    <property>
      <name>fs.raid.underlyingfs.impl</name>
-     <value>org.apche.hadoop.new.NewFileSystem</value>
+     <value>org.apache.hadoop.new.NewFileSystem</value>
      <description>Specify the filesystem that is layered immediately below the
        DistributedRaidFileSystem. By default, this value is DistributedFileSystem.
+     </description>
+   </property
+   }}}
+ 
+   Specify the BlockFixer implementation to use (default is DistBlockFixer):
+   {{{
+   <property>
+     <name>raid.blockfix.classname</name>
+     <value>org.apache.hadoop.raid.LocalBlockFixer</value>
+     <description>Specify the BlockFixer implementation to use.
+       The default is org.apache.hadoop.raid.DistBlockFixer.
      </description>
    </property
    }}}

Mime
View raw message