hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Update of "RandomWriter" by OwenOMalley
Date Wed, 28 Jun 2006 21:42:14 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by OwenOMalley:
http://wiki.apache.org/lucene-hadoop/RandomWriter

------------------------------------------------------------------------------
  '''RandomWriter''' example
  
- ''RandomWriter'' example writes random data to DFS using Map/Reduce. Each map takes a file
name as input and writes one Gig of random data to the DFS sequence file by generating multiple
records, each with a random key and a random value. A mapper does not emit any output and
the reduce phase is not used.
+ ''RandomWriter'' example writes 10 gig (by default) of random data/host to DFS using Map/Reduce.

+ 
+ Each map takes a single file name as input and writes random BytesWritable keys and values
to the DFS sequence file. The maps do not emit any output and the reduce phase is not used.
  
  The specifics of the generated data are configurable. The configuration variables are:
  
- || Name || Default Value || Description ||
+ || '''Name''' || '''Default Value''' || '''Description''' ||
  || test.randomwriter.maps_per_host || 10 || Number of maps/host ||
  || test.randomwrite.bytes_per_map || 1024*1024*1024 || Number of bytes written/map ||
  || test.randomwrite.min_key || 10 || minimum size of the key in bytes ||

Mime
View raw message