Message-Id: <3.0.3.32.19980415142210.00712800@mail.gamespot.com>
Date: Wed, 15 Apr 1998 14:22:10 -0700
To: Apache List <new-httpd@apache.org>
From: Ian Kallen <ian@gamespot.com>
Subject: Re: The trouble with benchmarks
In-Reply-To: <3533EBD0.158CCFA9@algroup.co.uk>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Sender: new-httpd-owner@apache.org
Precedence: bulk
Reply-To: new-httpd@apache.org

Quickness.  Correctness.  Integrated features for admin, content mgt and
reporting seem to be the checklist items that editors of comparisons look for.

I'm about to comb through the docs (well, the MS Word file I downloaded) on
ZD's Webbench (http://www.zdnet.com/zdbop/webbench/webbench.html).  Any
opinions from the Apache developer's corner on this benchmark
implementation?  From the description I've read thus far it _seems_ to be
the most advanced tool for this application.
-Ian

At 12:05 AM 4/15/98 +0100, Ben Laurie wrote:
>It occurs to me, having read Ken's thing about Vary, that the _real_
>objection to benchmarks is this: any fool can do it fast. Escpecially if
>they've had a year to practice. Doing it _right_ is the important thing.
>Vary is very difficult to get right. A good benchmark would measure
>compliance (or at least interoperability) as well as speed.
>
>Cheers,
>
>Ben.
>
>-- 
>Ben Laurie            |Phone: +44 (181) 735 0686|  Apache Group member
>Freelance Consultant  |Fax:   +44 (181) 735 0689|http://www.apache.org
>and Technical Director|Email: ben@algroup.co.uk |
>A.L. Digital Ltd,     |Apache-SSL author    http://www.apache-ssl.org/
>London, England.      |"Apache: TDG" http://www.ora.com/catalog/apache
>
>

--
Ian Kallen						ian@gamespot.com	
	Director of Technology and Web Administration
		GameSpot Incorporated
http://www.gamespot.com/		http://www.videogames.com/