hadoop-common-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Lucene-hadoop Wiki] Trivial Update of "DataProcessingBenchmarks" by udanax
Date Tue, 08 Jan 2008 08:39:45 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/lucene-hadoop/DataProcessingBenchmarks

------------------------------------------------------------------------------
  08/01/08 16:15:35 INFO mapred.JobClient:     Reduce input groups=201330
  08/01/08 16:15:35 INFO mapred.JobClient:     Reduce input records=705771
  08/01/08 16:15:35 INFO mapred.JobClient:     Reduce output records=201330
+ }}}
  
+  * Map was used for extract the IP address of the client requesting the web page.
+  * Reduce was used for summation.
+ 
+ {{{
  * Sort by Connection Time Count Map/Reduce Job start.
  ----------------------------------------------------------------------
  08/01/08 16:15:35 INFO mapred.FileInputFormat: Total input paths to process : 100
  08/01/08 16:15:36 INFO mapred.JobClient: Running job: job_200801081529_0006
  08/01/08 16:15:37 INFO mapred.JobClient:  map 0% reduce 0%
- 08/01/08 16:15:40 INFO mapred.JobClient:  map 10% reduce 0%
- 08/01/08 16:15:41 INFO mapred.JobClient:  map 42% reduce 0%
- 08/01/08 16:15:42 INFO mapred.JobClient:  map 91% reduce 0%
  ...
  08/01/08 16:33:54 INFO mapred.JobClient:  map 100% reduce 100%
  08/01/08 16:33:55 INFO mapred.JobClient: Job complete: job_200801081529_0006
@@ -68, +70 @@

  08/01/08 16:33:55 INFO mapred.JobClient:     Reduce input groups=19270
  08/01/08 16:33:55 INFO mapred.JobClient:     Reduce input records=84069
  08/01/08 16:33:55 INFO mapred.JobClient:     Reduce output records=200
+ }}}
  
+  * Map/Reduce was used for sort by count.
+ 
+ {{{
  ------------------------------------
  * Top 100 connector list :
  +--------------+-------------------+

Mime
View raw message