Mailing-List: contact dev-help@directory.apache.org; run by ezmlm
Precedence: bulk
Reply-To: "Apache Directory Developers List" <dev@directory.apache.org>
Received-SPF: pass (nike.apache.org: domain of akarasulu@gmail.com designates
 74.125.92.27 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=RJFzPDuHUxO11ZBkS+Nz7skNQfCfJ5qMgYei51G7gheG2FY99S5VM4DFM2W5NcQFxu
         pQr9dwugYmXYsYgJsI1vn/BOcBLAjXdVvt+7qyRpHGjdJkCyfp9gWSwLICK47ZBKbBgc
         BQuPH6LASRU9Hs5T6M0G7pz2MuUPvx4nA/v9U=
MIME-Version: 1.0
In-Reply-To: <d45b08f00902090852y4ee0558ata8f0b7abc4ecf654@mail.gmail.com>
References: <d45b08f00902090852y4ee0558ata8f0b7abc4ecf654@mail.gmail.com>
Date: Tue, 10 Feb 2009 19:11:14 -0500
Message-ID: <a32f6b020902101611r20e0317ekbb2ed62d12dd1a37@mail.gmail.com>
Subject: Re: About tests and Ldif injection annotations (completed)
From: Alex Karasulu <akarasulu@gmail.com>
To: Apache Directory Developers List <dev@directory.apache.org>
Content-Type: multipart/alternative; boundary=00221532c5b420929104629971da

--00221532c5b420929104629971da
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

On Mon, Feb 9, 2009 at 11:52 AM, Emmanuel Lecharny <elecharny@apache.org>wrote:

> Hi guys,
>
> the cool annotations we have, combined with the rollback system,
> allows us to run tests without any problem. Each test can play with
> data without interacting with the other tests. However, as the LDIF
> injection is done globally for each test, the rollback is also done
> globally. ie, if you inject a lot of data, you will have to revert a
> lot of data too, for each single test.
>
> We are using it today for one of our client, and as we have around 400
> entries to inject for our tests, it takes more or less a couple of
> seconds to run each test. At the end of the day, when we run our 150
> tests, we have to wait 10 minutes to run all of them.
>

Use suites and have a full cleanup take place between the suites. You have
various cleanup levels (test level, class level, suite level etc) and you
can set it up so that a suite class has an annotation which make it cleanup
when the suite is started with a PRISTINE server.  That's why all this was
put in there.  We use this today for the Apache DS tests.


>
> No need to tell that it's way faster ! I was able to run the
> SearchITest in less than 5 seconds compared to the usual 15 seconds
> for the very same tests (and i'm just talking of 4 entries injected
> and rollbacked for every tests).
>
> So I think this is the way to go. The only difficult point is that we
> have to deal with 5 different modes for tests :
> - PRISTINE
> - RESTART
> - ROLLBACK (the default)
> - CUMULATIVE
> - NOSERVICE.
>
> To me, the RESTART, CUMULATIVE and NOSERVICE mode seems a bit useless.


There are reasons for these - I can explain this tomorrow.  Please don't nix
this stuff until we discuss it somemore.


>
> The PRISTINE mode is used for one single test in which we declare two
> different factories, hence the need to clean up completely the server.
>
> I would suggest we get rid of the RESTART, CUMULATIVE and NOSERVICE
> mode in order to ease the implementation of my small improvement
> (otehriwse, there are too many cases to deal with, and i don't realy
> have time for that).
>
> wdyt?
>

I think it is a bad idea but I may be wrong.  Shit cannot remember that far
back when we did all this stuff.

Alex

--00221532c5b420929104629971da
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<br><br><div class=3D"gmail_quote">On Mon, Feb 9, 2009 at 11:52 AM, Emmanue=
l Lecharny <span dir=3D"ltr">&lt;<a href=3D"mailto:elecharny@apache.org">el=
echarny@apache.org</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quot=
e" style=3D"border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt =
0.8ex; padding-left: 1ex;">
Hi guys,<br>
<br>
the cool annotations we have, combined with the rollback system,<br>
allows us to run tests without any problem. Each test can play with<br>
data without interacting with the other tests. However, as the LDIF<br>
injection is done globally for each test, the rollback is also done<br>
globally. ie, if you inject a lot of data, you will have to revert a<br>
lot of data too, for each single test.<br>
<br>
We are using it today for one of our client, and as we have around 400<br>
entries to inject for our tests, it takes more or less a couple of<br>
seconds to run each test. At the end of the day, when we run our 150<br>
tests, we have to wait 10 minutes to run all of them.<br>
</blockquote><div><br>Use suites and have a full cleanup take place between=
 the suites. You have various cleanup levels (test level, class level, suit=
e level etc) and you can set it up so that a suite class has an annotation =
which make it cleanup when the suite is started with a PRISTINE server.&nbs=
p; That&#39;s why all this was put in there.&nbsp; We use this today for th=
e Apache DS tests.<br>
&nbsp;</div><blockquote class=3D"gmail_quote" style=3D"border-left: 1px sol=
id rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><br>
No need to tell that it&#39;s way faster ! I was able to run the<br>
SearchITest in less than 5 seconds compared to the usual 15 seconds<br>
for the very same tests (and i&#39;m just talking of 4 entries injected<br>
and rollbacked for every tests).<br>
<br>
So I think this is the way to go. The only difficult point is that we<br>
have to deal with 5 different modes for tests :<br>
- PRISTINE<br>
- RESTART<br>
- ROLLBACK (the default)<br>
- CUMULATIVE<br>
- NOSERVICE.<br>
<br>
To me, the RESTART, CUMULATIVE and NOSERVICE mode seems a bit useless.</blo=
ckquote><div><br>There are reasons for these - I can explain this tomorrow.=
&nbsp; Please don&#39;t nix this stuff until we discuss it somemore.<br>&nb=
sp;</div>
<blockquote class=3D"gmail_quote" style=3D"border-left: 1px solid rgb(204, =
204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><br>
The PRISTINE mode is used for one single test in which we declare two<br>
different factories, hence the need to clean up completely the server.<br>
<br>
I would suggest we get rid of the RESTART, CUMULATIVE and NOSERVICE<br>
mode in order to ease the implementation of my small improvement<br>
(otehriwse, there are too many cases to deal with, and i don&#39;t realy<br=
>
have time for that).<br>
<br>
wdyt?<br>
</blockquote></div><br>I think it is a bad idea but I may be wrong.&nbsp; S=
hit cannot remember that far back when we did all this stuff.<br><br>Alex<b=
r>

--00221532c5b420929104629971da--