Return-Path: Delivered-To: apmail-directory-dev-archive@www.apache.org Received: (qmail 31083 invoked from network); 23 Mar 2007 17:09:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 23 Mar 2007 17:09:32 -0000 Received: (qmail 69533 invoked by uid 500); 23 Mar 2007 17:09:39 -0000 Delivered-To: apmail-directory-dev-archive@directory.apache.org Received: (qmail 69491 invoked by uid 500); 23 Mar 2007 17:09:38 -0000 Mailing-List: contact dev-help@directory.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Apache Directory Developers List" Delivered-To: mailing list dev@directory.apache.org Received: (qmail 69480 invoked by uid 99); 23 Mar 2007 17:09:38 -0000 Received: from herse.apache.org (HELO herse.apache.org) (140.211.11.133) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2007 10:09:38 -0700 X-ASF-Spam-Status: No, hits=2.6 required=10.0 tests=HTML_00_10,HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (herse.apache.org: domain of elecharny@gmail.com designates 64.233.182.190 as permitted sender) Received: from [64.233.182.190] (HELO nf-out-0910.google.com) (64.233.182.190) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2007 10:09:30 -0700 Received: by nf-out-0910.google.com with SMTP id o25so2109351nfa for ; Fri, 23 Mar 2007 10:09:09 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:mime-version:content-type; b=AylRNp8yADrUVFDb7+cehKo6XiWD0pidnS5/+CIBMmXEWGwYhUFb6N66VmV2I9A/HcsaZWIlUIrW61lG7CdGTkn2nAmtVTHLaXH0iGx7DB9eJlONh9AcMB4b96BWUdT9U+1E68ZUwIWbZy6Q8PpoONuxe3VLdCZe8V2CEjEreAM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type; b=saJfwY7uKdG+btSbU1WYn4KoA5nA2KjXAmbhOld/CY5oEjNi0hA6h3ytQhWEc6XgJHPfsbEJIjlhNit5f2yaCAadl9NVT8QNyJbE+RgAYHPQYEutQGL2oes0iWw8ddtZQKeeQ+dpKVPkGSAux+hReVqZTZTNOzKN9f7/9h6xaOk= Received: by 10.78.185.7 with SMTP id i7mr1672634huf.1174669748345; Fri, 23 Mar 2007 10:09:08 -0700 (PDT) Received: by 10.78.23.3 with HTTP; Fri, 23 Mar 2007 10:09:08 -0700 (PDT) Message-ID: Date: Fri, 23 Mar 2007 18:09:08 +0100 From: "Emmanuel Lecharny" Reply-To: elecharny@iktek.com To: "Apache Directory Developers List" Subject: [Integration tests] How to speed up the tests MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_220647_12721056.1174669748291" X-Virus-Checked: Checked by ClamAV on apache.org ------=_Part_220647_12721056.1174669748291 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Hi, with the new schema handling system (the schema is now stored as Ldap entries in the server, and loaded at startup), the integration tests are taking forever (17 mins on my 3GhZ desktop, 13 minutes on my shinny Imac dual-core). The reason is that all the schema elements have to be read out of the server, and as the server is able to manage around 500 req/s (more or less)= , each test cost around a second, bare minimum. As we have around 150 tests in server-unit, this is around 3 minutes to run integration tests, and we have the double in core-unit, so it's 6 more minutes. We have a few options : 1) Improve the server so it can handle 5000 req/s, dividing the tests duration by ten : yeah, that would be cool, but... 2) Improve the tests to limit the number of server startup and shutdown to one by test (the setup should contain a test to check if the server has bee= n started or not before, and add code to feed the server and some other code to clean the server) 3) Write a new tool which will register all the operations to play them in revert order when finishing a test 4) any other smart idea, guys ? --=20 Cordialement, Emmanuel L=E9charny www.iktek.com ------=_Part_220647_12721056.1174669748291 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Hi,

with the new schema handling system (the schema is now stored as= Ldap entries in the server, and loaded at startup), the integration tests = are taking forever (17 mins on my 3GhZ desktop, 13 minutes on my shinny Ima= c dual-core).

The reason is that all the schema elements have to be read out of t= he server, and as the server is able to manage around 500 req/s (more or le= ss), each test cost around a second, bare minimum.

As we have aroun= d 150 tests in server-unit, this is around 3 minutes to run integration tes= ts, and we have the double in core-unit, so it's 6 more minutes.

We have a few options :
1) Improve the server so it can handle 5= 000 req/s, dividing the tests duration by ten : yeah, that would be cool, b= ut...
2) Improve the tests to limit the number of server startup and sh= utdown to one by test (the setup should contain a test to check if the serv= er has been started or not before, and add code to feed the server and some= other code to clean the server)
3) Write a new tool which will register all the operations to play them= in revert order when finishing a test
4) any other smart idea, guys ?
--
Cordialement,
Emmanuel L=E9charny
www.iktek.com ------=_Part_220647_12721056.1174669748291--