Dear Wiki user, You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification. The following page has been changed by udanax: http://wiki.apache.org/lucene-hadoop/DataProcessingBenchmarks ------------------------------------------------------------------------------ == Data Processing Benchmarks == + + === Group/Sort Processing Benchmarks === SQL > select ipaddress, count(*) from access_log group by ipaddress order by count(*) desc limit 0,100; [[BR]]''σ ,,count. ipaddress,, (τ ,,count,, (γ ,,count(ipaddress). ipaddress,, (access_log)))'' - ||||!MySql ||Hadoop|| + ||||!MySql 5.0.27, MyISAM||Hadoop-0.15.0 Release|| ||Index ||index ||non-index|| ||Machine ||1 ||1000|| ||Rows ||3,700,000 ||49,324,734|| @@ -21, +23 @@ 08/01/08 16:13:47 INFO mapred.JobClient: Running job: job_200801081529_0005 08/01/08 16:13:48 INFO mapred.JobClient: map 0% reduce 0% 08/01/08 16:13:54 INFO mapred.JobClient: map 1% reduce 0% - 08/01/08 16:13:56 INFO mapred.JobClient: map 2% reduce 0% - 08/01/08 16:14:01 INFO mapred.JobClient: map 6% reduce 0% - 08/01/08 16:14:03 INFO mapred.JobClient: map 8% reduce 0% - 08/01/08 16:14:05 INFO mapred.JobClient: map 10% reduce 0% - 08/01/08 16:14:07 INFO mapred.JobClient: map 23% reduce 0% - 08/01/08 16:14:08 INFO mapred.JobClient: map 24% reduce 0% ... - 08/01/08 16:15:32 INFO mapred.JobClient: map 100% reduce 84% - 08/01/08 16:15:33 INFO mapred.JobClient: map 100% reduce 92% 08/01/08 16:15:34 INFO mapred.JobClient: map 100% reduce 100% 08/01/08 16:15:35 INFO mapred.JobClient: Job complete: job_200801081529_0005 08/01/08 16:15:35 INFO mapred.JobClient: Counters: 11