Return-Path: Delivered-To: apmail-lucene-hadoop-commits-archive@locus.apache.org Received: (qmail 39033 invoked from network); 28 Jun 2006 21:42:36 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 28 Jun 2006 21:42:36 -0000 Received: (qmail 70801 invoked by uid 500); 28 Jun 2006 21:42:36 -0000 Delivered-To: apmail-lucene-hadoop-commits-archive@lucene.apache.org Received: (qmail 70735 invoked by uid 500); 28 Jun 2006 21:42:36 -0000 Mailing-List: contact hadoop-commits-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-commits@lucene.apache.org Received: (qmail 70725 invoked by uid 99); 28 Jun 2006 21:42:36 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Jun 2006 14:42:36 -0700 X-ASF-Spam-Status: No, hits=-0.0 required=10.0 tests=SPF_HELO_PASS X-Spam-Check-By: apache.org Received: from [192.87.106.226] (HELO ajax.apache.org) (192.87.106.226) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 28 Jun 2006 14:42:35 -0700 Received: from ajax.apache.org (localhost [127.0.0.1]) by ajax.apache.org (Postfix) with ESMTP id A0C156ACA9 for ; Wed, 28 Jun 2006 22:42:14 +0100 (BST) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: Apache Wiki To: hadoop-commits@lucene.apache.org Date: Wed, 28 Jun 2006 21:42:14 -0000 Message-ID: <20060628214214.636.56916@ajax.apache.org> Subject: [Lucene-hadoop Wiki] Update of "RandomWriter" by OwenOMalley X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification. The following page has been changed by OwenOMalley: http://wiki.apache.org/lucene-hadoop/RandomWriter ------------------------------------------------------------------------------ '''RandomWriter''' example - ''RandomWriter'' example writes random data to DFS using Map/Reduce. Each map takes a file name as input and writes one Gig of random data to the DFS sequence file by generating multiple records, each with a random key and a random value. A mapper does not emit any output and the reduce phase is not used. + ''RandomWriter'' example writes 10 gig (by default) of random data/host to DFS using Map/Reduce. + + Each map takes a single file name as input and writes random BytesWritable keys and values to the DFS sequence file. The maps do not emit any output and the reduce phase is not used. The specifics of the generated data are configurable. The configuration variables are: - || Name || Default Value || Description || + || '''Name''' || '''Default Value''' || '''Description''' || || test.randomwriter.maps_per_host || 10 || Number of maps/host || || test.randomwrite.bytes_per_map || 1024*1024*1024 || Number of bytes written/map || || test.randomwrite.min_key || 10 || minimum size of the key in bytes ||