Message-Id: <199708051002.MAA06152@en1.engelschall.com>
Subject: RFD: Apache Regression Test Suite (ARTS) !!
To: new-httpd@apache.org (Apache Developer ML)
Date: Tue, 5 Aug 1997 12:02:35 +0200
From: rse@engelschall.com (Ralf S. Engelschall)
Organization: Engelschall, Germany.
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Sender: new-httpd-owner@apache.org
Precedence: bulk
Reply-To: new-httpd@apache.org


Yesterday I've tried to start the Apache Documentation Project (ADP) by
initially evualiting tools and then establishing the SGML skeleton an the
first content. Today I've tried to start another important project:

   The Apache Regression Test Suite (ARTS)

As discussed in the past, Apache needs such a test suite. So I've browsed
through my brain and knowledge again and established such a beasts runtime
engine end environment and the first two tests itself.

The idea is the following: 
   1. We use software leverage and take advantage of Perl's Test::Harness and
      LWP packages.
   2. We provide a Makefile and a bootstrapping script to be able to easily
      apply the test suite to a particular httpd.
   3. We provide utilitiy functions to make the individual tests as short as
      possible while providing as much flexibility we can.

The first result can be found on http://www.apache.org/~rse/. 
Grab the ARTS.tar.gz and unpack it anywhere. Then do

   $ cd ARTS
   $ make HTTPD=/path/to/our/apache/src/httpd

For me this looks like this:

| rse@en1:/e/apache/www/ARTS
| :> make HTTPD=/e/apache/test/src/httpd
| __ CONFIGURATION __
| Perl Interpreter (v5.004_01) [/sw/bin/perl]: 
| Apache httpd (Apache/1.3a2-dev): /e/apache/test/src/httpd
| 
| __ RUNNING TEST SUITE __
| t/01-basic..........ok
| t/02-get............ok
| All tests successful.
| Files=2,  Tests=3, 10 secs ( 1.95 cusr  0.30 csys =  2.24 cpu)
| rse@en1:/e/apache/www/ARTS
| :>

That's all folks. Currently there are 3 simple tests just to see if the
approach works as expected.

Feedback?
                                       Ralf S. Engelschall
                                       rse@engelschall.com
                                       www.engelschall.com