Return-Path: Delivered-To: apmail-lucene-hadoop-commits-archive@locus.apache.org Received: (qmail 30705 invoked from network); 8 Jan 2008 08:40:09 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 8 Jan 2008 08:40:09 -0000 Received: (qmail 16114 invoked by uid 500); 8 Jan 2008 08:39:58 -0000 Delivered-To: apmail-lucene-hadoop-commits-archive@lucene.apache.org Received: (qmail 16094 invoked by uid 500); 8 Jan 2008 08:39:58 -0000 Mailing-List: contact hadoop-commits-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-commits@lucene.apache.org Received: (qmail 16085 invoked by uid 99); 8 Jan 2008 08:39:57 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jan 2008 00:39:57 -0800 X-ASF-Spam-Status: No, hits=-100.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.130] (HELO eos.apache.org) (140.211.11.130) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jan 2008 08:39:54 +0000 Received: from eos.apache.org (localhost [127.0.0.1]) by eos.apache.org (Postfix) with ESMTP id E62D9D2D5 for ; Tue, 8 Jan 2008 08:39:45 +0000 (GMT) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: Apache Wiki To: hadoop-commits@lucene.apache.org Date: Tue, 08 Jan 2008 08:39:45 -0000 Message-ID: <20080108083945.28.88959@eos.apache.org> Subject: [Lucene-hadoop Wiki] Trivial Update of "DataProcessingBenchmarks" by udanax X-Virus-Checked: Checked by ClamAV on apache.org Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification. The following page has been changed by udanax: http://wiki.apache.org/lucene-hadoop/DataProcessingBenchmarks ------------------------------------------------------------------------------ 08/01/08 16:15:35 INFO mapred.JobClient: Reduce input groups=201330 08/01/08 16:15:35 INFO mapred.JobClient: Reduce input records=705771 08/01/08 16:15:35 INFO mapred.JobClient: Reduce output records=201330 + }}} + * Map was used for extract the IP address of the client requesting the web page. + * Reduce was used for summation. + + {{{ * Sort by Connection Time Count Map/Reduce Job start. ---------------------------------------------------------------------- 08/01/08 16:15:35 INFO mapred.FileInputFormat: Total input paths to process : 100 08/01/08 16:15:36 INFO mapred.JobClient: Running job: job_200801081529_0006 08/01/08 16:15:37 INFO mapred.JobClient: map 0% reduce 0% - 08/01/08 16:15:40 INFO mapred.JobClient: map 10% reduce 0% - 08/01/08 16:15:41 INFO mapred.JobClient: map 42% reduce 0% - 08/01/08 16:15:42 INFO mapred.JobClient: map 91% reduce 0% ... 08/01/08 16:33:54 INFO mapred.JobClient: map 100% reduce 100% 08/01/08 16:33:55 INFO mapred.JobClient: Job complete: job_200801081529_0006 @@ -68, +70 @@ 08/01/08 16:33:55 INFO mapred.JobClient: Reduce input groups=19270 08/01/08 16:33:55 INFO mapred.JobClient: Reduce input records=84069 08/01/08 16:33:55 INFO mapred.JobClient: Reduce output records=200 + }}} + * Map/Reduce was used for sort by count. + + {{{ ------------------------------------ * Top 100 connector list : +--------------+-------------------+